Abstract:
As a promising approach, Clustered Federated Learning (CFL) enables personalized model aggregation for heterogeneous clients. However, facing dynamic and open edge networ...Show MoreMetadata
Abstract:
As a promising approach, Clustered Federated Learning (CFL) enables personalized model aggregation for heterogeneous clients. However, facing dynamic and open edge networks, previous CFL rarely considers the impact of dynamic client data on clustering validity, or sensitively identifies low-quality parameters from highly heterogeneous client models. Moreover, the device heterogeneity in each cluster leads to unbalanced model transmission delay, thus reducing the system efficiency. To tackle the above issues, this paper proposes a Robust and Efficient Clustered Federated System (REC-Fed). First, a Hierarchical Attention based Robust Aggregation (HARA) method is designed to realize layer-wise model customization for clients, meanwhile keeping the clustering validity under dynamic client data distribution. In addition, the fine-grained parameter detection in HARA provides a natural advantage to detect low-quality parameters, which improves the robustness of CFL systems. Second, to realize efficient synchronous model transmission, an Adaptive Model Transmission Optimization (AMTO) is proposed to jointly optimize the model compression and bandwidth allocation for heterogenous clients. Finally, we theoretically analyze the convergence of REC-Fed and conduct experiments on several personalization tasks, which demonstrate that our REC-Fed has significant improvement on flexibility, robustness and efficiency.
Published in: IEEE Transactions on Mobile Computing ( Volume: 23, Issue: 12, December 2024)
Funding Agency:

School of Computer Science and Engineering, Central South University, Changsha, China
Jialin Guo received the BS degree on Internet of Things from Central South University, in 2021. He is currently working towards the PhD degree with the School of Computer Science and Engineering, Central South University, China. His research interests include federated learning, Internet of Things and edge computing.
Jialin Guo received the BS degree on Internet of Things from Central South University, in 2021. He is currently working towards the PhD degree with the School of Computer Science and Engineering, Central South University, China. His research interests include federated learning, Internet of Things and edge computing.View more

Hunan International Scientific and Technological Cooperation Base of Intelligent Network, Key Laboratory of Hunan Province for Internet of Things and Information Security, Key Laboratory of Intelligent Computing & Information Processing of Ministry of Education, School of Computer Science, Xiangtan University, Xiangtan, China
Zhetao Li (Member, IEEE) received the BEng degree from Xiangtan University, Xiangtan, China, in 2002, the MEng degree from Beihang University, Beijing, China, in 2005, and the PhD degree in computer application technology from Hunan University, Changsha, China, in 2010. He is currently a professor with the Key Laboratory of Hunan Province for Internet of Things and Information Security and School of Computer Science, Xian...Show More
Zhetao Li (Member, IEEE) received the BEng degree from Xiangtan University, Xiangtan, China, in 2002, the MEng degree from Beihang University, Beijing, China, in 2005, and the PhD degree in computer application technology from Hunan University, Changsha, China, in 2010. He is currently a professor with the Key Laboratory of Hunan Province for Internet of Things and Information Security and School of Computer Science, Xian...View more

School of Computer Science and Engineering, Central South University, Changsha, China
Anfeng Liu received the MSc and PhD degrees in computer science from Central South University, China, in 2002 and 2005, respectively. He is currently a professor with the School of Computer Science and Engineering, Central South University, China. His major research interests include Wireless Sensor Networks, Internet of Things, information security, edge computing and crowdsourcing. He has published 4 books and more than...Show More
Anfeng Liu received the MSc and PhD degrees in computer science from Central South University, China, in 2002 and 2005, respectively. He is currently a professor with the School of Computer Science and Engineering, Central South University, China. His major research interests include Wireless Sensor Networks, Internet of Things, information security, edge computing and crowdsourcing. He has published 4 books and more than...View more

School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
Xiong Li received the master's degree in mathematics and cryptography from Shaanxi Normal University (SNNU), China, in 2009, and the PhD degree in computer science and technology from the Beijing University of Posts and Telecommunications (BUPT), China, in 2012. How is a professor with the School of Computer Science and Engineering of University of Electronic Science and Technology of China. He has published more than 50 ...Show More
Xiong Li received the master's degree in mathematics and cryptography from Shaanxi Normal University (SNNU), China, in 2009, and the PhD degree in computer science and technology from the Beijing University of Posts and Telecommunications (BUPT), China, in 2012. How is a professor with the School of Computer Science and Engineering of University of Electronic Science and Technology of China. He has published more than 50 ...View more

School of Computer Science and Engineering, Central South University, Changsha, China
Ting Chen received the PhD degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, 2013. Now, he is a professor with the UESTC. His research interests include focuses on blockchain, smart contract, and program analysis.
Ting Chen received the PhD degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, 2013. Now, he is a professor with the UESTC. His research interests include focuses on blockchain, smart contract, and program analysis.View more

School of Computer Science and Engineering, Central South University, Changsha, China
Jialin Guo received the BS degree on Internet of Things from Central South University, in 2021. He is currently working towards the PhD degree with the School of Computer Science and Engineering, Central South University, China. His research interests include federated learning, Internet of Things and edge computing.
Jialin Guo received the BS degree on Internet of Things from Central South University, in 2021. He is currently working towards the PhD degree with the School of Computer Science and Engineering, Central South University, China. His research interests include federated learning, Internet of Things and edge computing.View more

Hunan International Scientific and Technological Cooperation Base of Intelligent Network, Key Laboratory of Hunan Province for Internet of Things and Information Security, Key Laboratory of Intelligent Computing & Information Processing of Ministry of Education, School of Computer Science, Xiangtan University, Xiangtan, China
Zhetao Li (Member, IEEE) received the BEng degree from Xiangtan University, Xiangtan, China, in 2002, the MEng degree from Beihang University, Beijing, China, in 2005, and the PhD degree in computer application technology from Hunan University, Changsha, China, in 2010. He is currently a professor with the Key Laboratory of Hunan Province for Internet of Things and Information Security and School of Computer Science, Xiangtan University, China. He was a visiting researcher with Ajou University, South Korea from May to August 2012. His research interests include cloud computing, artificial intelligence, and multimedia signal processing.
Zhetao Li (Member, IEEE) received the BEng degree from Xiangtan University, Xiangtan, China, in 2002, the MEng degree from Beihang University, Beijing, China, in 2005, and the PhD degree in computer application technology from Hunan University, Changsha, China, in 2010. He is currently a professor with the Key Laboratory of Hunan Province for Internet of Things and Information Security and School of Computer Science, Xiangtan University, China. He was a visiting researcher with Ajou University, South Korea from May to August 2012. His research interests include cloud computing, artificial intelligence, and multimedia signal processing.View more

School of Computer Science and Engineering, Central South University, Changsha, China
Anfeng Liu received the MSc and PhD degrees in computer science from Central South University, China, in 2002 and 2005, respectively. He is currently a professor with the School of Computer Science and Engineering, Central South University, China. His major research interests include Wireless Sensor Networks, Internet of Things, information security, edge computing and crowdsourcing. He has published 4 books and more than 100 international journal and conference papers.
Anfeng Liu received the MSc and PhD degrees in computer science from Central South University, China, in 2002 and 2005, respectively. He is currently a professor with the School of Computer Science and Engineering, Central South University, China. His major research interests include Wireless Sensor Networks, Internet of Things, information security, edge computing and crowdsourcing. He has published 4 books and more than 100 international journal and conference papers.View more

School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
Xiong Li received the master's degree in mathematics and cryptography from Shaanxi Normal University (SNNU), China, in 2009, and the PhD degree in computer science and technology from the Beijing University of Posts and Telecommunications (BUPT), China, in 2012. How is a professor with the School of Computer Science and Engineering of University of Electronic Science and Technology of China. He has published more than 50 referred journal papers in his research interests, which include cryptography, information security, cloud computing security etc. He has served on TPC member of several international conferences on information security and reviewer for more than 30 ISI indexed journals. He is a winner of Journal of Network and Computer Applications 2015 best research paper award.
Xiong Li received the master's degree in mathematics and cryptography from Shaanxi Normal University (SNNU), China, in 2009, and the PhD degree in computer science and technology from the Beijing University of Posts and Telecommunications (BUPT), China, in 2012. How is a professor with the School of Computer Science and Engineering of University of Electronic Science and Technology of China. He has published more than 50 referred journal papers in his research interests, which include cryptography, information security, cloud computing security etc. He has served on TPC member of several international conferences on information security and reviewer for more than 30 ISI indexed journals. He is a winner of Journal of Network and Computer Applications 2015 best research paper award.View more

School of Computer Science and Engineering, Central South University, Changsha, China
Ting Chen received the PhD degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, 2013. Now, he is a professor with the UESTC. His research interests include focuses on blockchain, smart contract, and program analysis.
Ting Chen received the PhD degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, 2013. Now, he is a professor with the UESTC. His research interests include focuses on blockchain, smart contract, and program analysis.View more