Hwamei: A Learning-Based Synchronization Scheme for Hierarchical Federated Learning

Tianyu Qi, Yufeng Zhan, Peng Li, Jingcai Guo, Yuanqing Xia

科研成果: 书/报告/会议事项章节会议稿件同行评审

5 引用 (Scopus)

摘要

Federated learning (FL) enables collaborative model training among distributed devices without data sharing, but existing FL suffers from poor scalability because of global model synchronization. To address this issue, hierarchical federated learning (HFL) has been recently proposed to let edge servers aggregate models of devices in proximity, while synchronizing via the cloud periodically. However, a critical open challenge about how to design a good synchronization scheme (when devices and edges should be synchronized) is still unsolved. Devices are heterogeneous in computing and communication capability, and their data could be non-IID. No existing work can well synchronize various roles (e.g., devices and edge) in HFL to guarantee high learning efficiency and accuracy. In this paper, we propose a learning-based synchronization scheme for HFL systems. By collecting data such as edge models, CPU usage, communication time, etc., we design a deep reinforcement learning-based approach to decide the frequencies of cloud aggregation and edge aggregation, respectively. The proposed scheme well considers device heterogeneity, non-IID data and device mobility, to maximize the training model accuracy while minimizing the energy overhead. We build an HFL testbed and conduct experiments using real data obtained from Raspberry Pi and Alibaba Cloud. Extensive experimental results have confirmed the effectiveness of Hwamei.

源语言英语
主期刊名Proceedings - 2023 IEEE 43rd International Conference on Distributed Computing Systems, ICDCS 2023
出版商Institute of Electrical and Electronics Engineers Inc.
534-544
页数11
ISBN(电子版)9798350339864
DOI
出版状态已出版 - 2023
活动43rd IEEE International Conference on Distributed Computing Systems, ICDCS 2023 - Hong Kong, 中国
期限: 18 7月 202321 7月 2023

出版系列

姓名Proceedings - International Conference on Distributed Computing Systems
2023-July

会议

会议43rd IEEE International Conference on Distributed Computing Systems, ICDCS 2023
国家/地区中国
Hong Kong
时期18/07/2321/07/23

指纹

探究 'Hwamei: A Learning-Based Synchronization Scheme for Hierarchical Federated Learning' 的科研主题。它们共同构成独一无二的指纹。

引用此