Local Differential Privacy-Based Federated Learning under Personalized Settings

Xia Wu, Lei Xu*, Liehuang Zhu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)

Abstract

Federated learning is a distributed machine learning paradigm, which utilizes multiple clients’ data to train a model. Although federated learning does not require clients to disclose their original data, studies have shown that attackers can infer clients’ privacy by analyzing the local models shared by clients. Local differential privacy (LDP) can help to solve the above privacy issue. However, most of the existing federated learning studies based on LDP, rarely consider the diverse privacy requirements of clients. In this paper, we propose an LDP-based federated learning framework, that can meet the personalized privacy requirements of clients. We consider both independent identically distributed (IID) datasets and non-independent identically distributed (non-IID) datasets, and design model perturbation methods, respectively. Moreover, we propose two model aggregation methods, namely weighted average method and probability-based selection method. The main idea, is to weaken the impact of those privacy-conscious clients, who choose relatively small privacy budgets, on the federated model. Experiments on three commonly used datasets, namely MNIST, Fashion-MNIST, and forest cover-types, show that the proposed aggregation methods perform better than the classic arithmetic average method, in the personalized privacy preserving scenario.

Original languageEnglish
Article number4168
JournalApplied Sciences (Switzerland)
Volume13
Issue number7
DOIs
Publication statusPublished - Apr 2023

Keywords

  • federated learning
  • local differential privacy
  • model aggregation
  • model perturbation
  • personalized privacy preserving

Fingerprint

Dive into the research topics of 'Local Differential Privacy-Based Federated Learning under Personalized Settings'. Together they form a unique fingerprint.

Cite this