跳到主要导航 跳到搜索 跳到主要内容

FedPrune: Personalized and Communication-Efficient Federated Learning on Non-IID Data

  • Yang Liu
  • , Yi Zhao*
  • , Guangmeng Zhou
  • , Ke Xu
  • *此作品的通讯作者
  • Tsinghua University
  • Peng Cheng Laboratory

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Federated learning (FL) has been widely deployed in edge computing scenarios. However, FL-related technologies are still facing severe challenges while evolving rapidly. Among them, statistical heterogeneity (i.e., non-IID) seriously hinders the wide deployment of FL. In our work, we propose a new framework for communication-efficient and personalized federated learning, namely FedPrune. More specifically, under the newly proposed FL framework, each client trains a converged model locally to obtain critical parameters and substructure that guide the pruning of the network participating FL. FedPrune is able to achieve high accuracy while greatly reducing communication overhead. Moreover, each client learns a personalized model in FedPrune. Experimental results has demonstrated that FedPrune achieves the best accuracy in image recognition task with varying degrees of reduced communication costs compared to the three baseline methods.

源语言英语
主期刊名Neural Information Processing - 28th International Conference, ICONIP 2021, Proceedings
编辑Teddy Mantoro, Minho Lee, Media Anugerah Ayu, Kok Wai Wong, Achmad Nizar Hidayanto
出版商Springer Science and Business Media Deutschland GmbH
430-437
页数8
ISBN(印刷版)9783030923068
DOI
出版状态已出版 - 2021
已对外发布
活动28th International Conference on Neural Information Processing, ICONIP 2021 - Virtual, Online
期限: 8 12月 202112 12月 2021

丛书

姓名Communications in Computer and Information Science
1516 CCIS
ISSN(印刷版)1865-0929
ISSN(电子版)1865-0937

会议

会议28th International Conference on Neural Information Processing, ICONIP 2021
Virtual, Online
时期8/12/2112/12/21

学术指纹

探究 'FedPrune: Personalized and Communication-Efficient Federated Learning on Non-IID Data' 的科研主题。它们共同构成独一无二的学术指纹。

引用此