Skip to main navigation Skip to search Skip to main content

FedPrune: Personalized and Communication-Efficient Federated Learning on Non-IID Data

  • Yang Liu
  • , Yi Zhao*
  • , Guangmeng Zhou
  • , Ke Xu
  • *Corresponding author for this work
  • Tsinghua University
  • Peng Cheng Laboratory

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Federated learning (FL) has been widely deployed in edge computing scenarios. However, FL-related technologies are still facing severe challenges while evolving rapidly. Among them, statistical heterogeneity (i.e., non-IID) seriously hinders the wide deployment of FL. In our work, we propose a new framework for communication-efficient and personalized federated learning, namely FedPrune. More specifically, under the newly proposed FL framework, each client trains a converged model locally to obtain critical parameters and substructure that guide the pruning of the network participating FL. FedPrune is able to achieve high accuracy while greatly reducing communication overhead. Moreover, each client learns a personalized model in FedPrune. Experimental results has demonstrated that FedPrune achieves the best accuracy in image recognition task with varying degrees of reduced communication costs compared to the three baseline methods.

Original languageEnglish
Title of host publicationNeural Information Processing - 28th International Conference, ICONIP 2021, Proceedings
EditorsTeddy Mantoro, Minho Lee, Media Anugerah Ayu, Kok Wai Wong, Achmad Nizar Hidayanto
PublisherSpringer Science and Business Media Deutschland GmbH
Pages430-437
Number of pages8
ISBN (Print)9783030923068
DOIs
Publication statusPublished - 2021
Externally publishedYes
Event28th International Conference on Neural Information Processing, ICONIP 2021 - Virtual, Online
Duration: 8 Dec 202112 Dec 2021

Publication series

NameCommunications in Computer and Information Science
Volume1516 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference28th International Conference on Neural Information Processing, ICONIP 2021
CityVirtual, Online
Period8/12/2112/12/21

Keywords

  • Federated learning
  • Network pruning
  • Private preserving

Fingerprint

Dive into the research topics of 'FedPrune: Personalized and Communication-Efficient Federated Learning on Non-IID Data'. Together they form a unique fingerprint.

Cite this