TY - GEN
T1 - Personalized Federated Prompt Learning for Vision-Language Models
T2 - 19th International Conference on Knowledge Science, Engineering and Management, KSEM 2026
AU - Xin, Yuzhe
AU - Yu, Jing
AU - Gai, Keke
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2027.
PY - 2027
Y1 - 2027
N2 - Federated Prompt Learning (FPL) has emerged as an efficient paradigm for adapting large Vision-Language Models (VLMs) in decentralized environments. By optimizing lightweight prompt parameters instead of full model weights, FPL reduces communication and computation costs while preserving the generalization ability of foundation models. However, data heterogeneity across clients makes personalization a core issue in practical federated settings. Diverse data distributions, task preferences, and sample scales often limit the effectiveness of a single global prompt. This survey provides a systematic review of recent advances in personalized FPL. We first introduce the basic formulation of FPL and summarize common prompt representation, including textual, visual, and multimodal prompts. We then classified the existing personalized methods from the perspectives of granularity and mechanism, covering decoupled prompts, prompt generation, and prompt selection. We further provide a comparative analysis of these mechanisms and carry out an empirical study on common methods. Furthermore, we discuss key challenges related to robustness under data heterogeneity, personalization under black-box constraints, and privacy risks in FPL. By clarifying the trade-offs of personalized FPL, this survey aims to provide a structured reference for researchers working on personalized federated adaptation of VLMs.
AB - Federated Prompt Learning (FPL) has emerged as an efficient paradigm for adapting large Vision-Language Models (VLMs) in decentralized environments. By optimizing lightweight prompt parameters instead of full model weights, FPL reduces communication and computation costs while preserving the generalization ability of foundation models. However, data heterogeneity across clients makes personalization a core issue in practical federated settings. Diverse data distributions, task preferences, and sample scales often limit the effectiveness of a single global prompt. This survey provides a systematic review of recent advances in personalized FPL. We first introduce the basic formulation of FPL and summarize common prompt representation, including textual, visual, and multimodal prompts. We then classified the existing personalized methods from the perspectives of granularity and mechanism, covering decoupled prompts, prompt generation, and prompt selection. We further provide a comparative analysis of these mechanisms and carry out an empirical study on common methods. Furthermore, we discuss key challenges related to robustness under data heterogeneity, personalization under black-box constraints, and privacy risks in FPL. By clarifying the trade-offs of personalized FPL, this survey aims to provide a structured reference for researchers working on personalized federated adaptation of VLMs.
KW - Federated Learning
KW - Personalization
KW - Privacy Preservation
KW - Prompt Learning
KW - Vision-Language Models
UR - https://www.scopus.com/pages/publications/105046299398
U2 - 10.1007/978-981-92-2856-0_7
DO - 10.1007/978-981-92-2856-0_7
M3 - Conference contribution
AN - SCOPUS:105046299398
SN - 9789819228553
T3 - Lecture Notes in Computer Science
SP - 90
EP - 104
BT - Knowledge Science, Engineering and Management - 19th International Conference, KSEM 2026, Proceedings
A2 - Niu, Jianwei
A2 - Qiu, Meikang
A2 - Cao, Cungen
PB - Springer Science and Business Media Deutschland GmbH
Y2 - 17 July 2026 through 19 July 2026
ER -