Skip to main navigation Skip to search Skip to main content

Personalized Federated Prompt Learning for Vision-Language Models: A Survey

  • Yuzhe Xin
  • , Jing Yu*
  • , Keke Gai*
  • *Corresponding author for this work
  • Beijing Institute of Technology
  • Minzu University of China
  • Zhongguancun Academy

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Federated Prompt Learning (FPL) has emerged as an efficient paradigm for adapting large Vision-Language Models (VLMs) in decentralized environments. By optimizing lightweight prompt parameters instead of full model weights, FPL reduces communication and computation costs while preserving the generalization ability of foundation models. However, data heterogeneity across clients makes personalization a core issue in practical federated settings. Diverse data distributions, task preferences, and sample scales often limit the effectiveness of a single global prompt. This survey provides a systematic review of recent advances in personalized FPL. We first introduce the basic formulation of FPL and summarize common prompt representation, including textual, visual, and multimodal prompts. We then classified the existing personalized methods from the perspectives of granularity and mechanism, covering decoupled prompts, prompt generation, and prompt selection. We further provide a comparative analysis of these mechanisms and carry out an empirical study on common methods. Furthermore, we discuss key challenges related to robustness under data heterogeneity, personalization under black-box constraints, and privacy risks in FPL. By clarifying the trade-offs of personalized FPL, this survey aims to provide a structured reference for researchers working on personalized federated adaptation of VLMs.

Original languageEnglish
Title of host publicationKnowledge Science, Engineering and Management - 19th International Conference, KSEM 2026, Proceedings
EditorsJianwei Niu, Meikang Qiu, Cungen Cao
PublisherSpringer Science and Business Media Deutschland GmbH
Pages90-104
Number of pages15
ISBN (Print)9789819228553
DOIs
Publication statusPublished - 2027
Event19th International Conference on Knowledge Science, Engineering and Management, KSEM 2026 - Beijing, China
Duration: 17 Jul 202619 Jul 2026

Publication series

NameLecture Notes in Computer Science
Volume16633 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference19th International Conference on Knowledge Science, Engineering and Management, KSEM 2026
Country/TerritoryChina
CityBeijing
Period17/07/2619/07/26

Keywords

  • Federated Learning
  • Personalization
  • Privacy Preservation
  • Prompt Learning
  • Vision-Language Models

Fingerprint

Dive into the research topics of 'Personalized Federated Prompt Learning for Vision-Language Models: A Survey'. Together they form a unique fingerprint.

Cite this