跳到主要导航 跳到搜索 跳到主要内容

Personalized Federated Prompt Learning for Vision-Language Models: A Survey

  • Yuzhe Xin
  • , Jing Yu*
  • , Keke Gai*
  • *此作品的通讯作者
  • Beijing Institute of Technology
  • Minzu University of China
  • Zhongguancun Academy

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Federated Prompt Learning (FPL) has emerged as an efficient paradigm for adapting large Vision-Language Models (VLMs) in decentralized environments. By optimizing lightweight prompt parameters instead of full model weights, FPL reduces communication and computation costs while preserving the generalization ability of foundation models. However, data heterogeneity across clients makes personalization a core issue in practical federated settings. Diverse data distributions, task preferences, and sample scales often limit the effectiveness of a single global prompt. This survey provides a systematic review of recent advances in personalized FPL. We first introduce the basic formulation of FPL and summarize common prompt representation, including textual, visual, and multimodal prompts. We then classified the existing personalized methods from the perspectives of granularity and mechanism, covering decoupled prompts, prompt generation, and prompt selection. We further provide a comparative analysis of these mechanisms and carry out an empirical study on common methods. Furthermore, we discuss key challenges related to robustness under data heterogeneity, personalization under black-box constraints, and privacy risks in FPL. By clarifying the trade-offs of personalized FPL, this survey aims to provide a structured reference for researchers working on personalized federated adaptation of VLMs.

源语言英语
主期刊名Knowledge Science, Engineering and Management - 19th International Conference, KSEM 2026, Proceedings
编辑Jianwei Niu, Meikang Qiu, Cungen Cao
出版商Springer Science and Business Media Deutschland GmbH
90-104
页数15
ISBN(印刷版)9789819228553
DOI
出版状态已出版 - 2027
活动19th International Conference on Knowledge Science, Engineering and Management, KSEM 2026 - Beijing, 中国
期限: 17 7月 202619 7月 2026

丛书

姓名Lecture Notes in Computer Science
16633 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议19th International Conference on Knowledge Science, Engineering and Management, KSEM 2026
国家/地区中国
Beijing
时期17/07/2619/07/26

学术指纹

探究 'Personalized Federated Prompt Learning for Vision-Language Models: A Survey' 的科研主题。它们共同构成独一无二的学术指纹。

引用此