Abstract:
Federated learning (FL) is widely adopted in traffic forecasting tasks involving large-scale IoT-enabled sensor data since its decentralization nature enables data provid...Show MoreMetadata
Abstract:
Federated learning (FL) is widely adopted in traffic forecasting tasks involving large-scale IoT-enabled sensor data since its decentralization nature enables data providers’ privacy to be preserved. When employing state-of-the-art deep learning-based traffic predictors in FL systems, the existing FL frameworks confront overlarge communication overhead when transmitting these models’ parameter updates since the modeling depth and breadth renders them incorporating an enormous number of parameters. In this article, we propose a practical FL scheme, namely, Clustering-based hierarchical and Two-step-optimized FL (CTFed), to tackle this issue. The proposed scheme follows a divide et impera strategy that clusters the clients into multiple groups based on the similarity between their local models’ parameters. We integrate the particle swarm optimization algorithm and devises a two-step approach for local model optimization. This scheme enables only one but representative local model update from each cluster to be uploaded to the central server, thus reduces the communication overhead of the model updates transmission in FL. CTFed is orthogonal to the gradient compression- or sparsification-based approaches so that they can orchestrate to optimize the communication overhead. Extensive case studies on three real-world data sets and three state-of-the-art models demonstrate the outstanding training efficiency, accurate prediction performance, and robustness to unstable network environments of the proposed scheme.
Published in: IEEE Internet of Things Journal ( Volume: 9, Issue: 14, 15 July 2022)
Funding Agency:

Department of Computer Science and Engineering, Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation, Southern University of Science and Technology, Shenzhen, China
Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
Chenhan Zhang (Student Member, IEEE) received the B.Eng. degrees in telecommunication engineering from the University of Wollongong, Wollongong, NSW, Australia and Zhengzhou University, Zhengzhou, China, in 2017 and 2018, respectively, and the M.S. degree in engineering management from the City University of Hong Kong, Hong Kong, in 2019. He is currently pursuing the Ph.D. degree with the Faculty of Engineering and Inform...Show More
Chenhan Zhang (Student Member, IEEE) received the B.Eng. degrees in telecommunication engineering from the University of Wollongong, Wollongong, NSW, Australia and Zhengzhou University, Zhengzhou, China, in 2017 and 2018, respectively, and the M.S. degree in engineering management from the City University of Hong Kong, Hong Kong, in 2019. He is currently pursuing the Ph.D. degree with the Faculty of Engineering and Inform...View more

Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
Lei Cui (Member, IEEE) received the Ph.D. degree from Deakin University, Melbourne, VIC, Australia, in 2021.
He has authored or coauthored more than 20 publications, including monographs, book chapters, and journal and conference papers. Some of his publications have been published in the top venues, such as IEEE Transactions on Industrial Informatics, IEEE Transactions on Network and Service Management, and IEEE Transacti...Show More
Lei Cui (Member, IEEE) received the Ph.D. degree from Deakin University, Melbourne, VIC, Australia, in 2021.
He has authored or coauthored more than 20 publications, including monographs, book chapters, and journal and conference papers. Some of his publications have been published in the top venues, such as IEEE Transactions on Industrial Informatics, IEEE Transactions on Network and Service Management, and IEEE Transacti...View more

Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
Shui Yu (Senior Member, IEEE) received the Ph.D. degree from Deakin University, Geelong, VIC, Australia, in 2004.
He is currently a Professor with the School of Computer Science, University of Technology Sydney, Sydney, NSW, Australia. He has published three monographs and edited two books, more than 400 technical papers, including top journals and top conferences, such as IEEE Transactions on Parallel and Distributed Syst...Show More
Shui Yu (Senior Member, IEEE) received the Ph.D. degree from Deakin University, Geelong, VIC, Australia, in 2004.
He is currently a Professor with the School of Computer Science, University of Technology Sydney, Sydney, NSW, Australia. He has published three monographs and edited two books, more than 400 technical papers, including top journals and top conferences, such as IEEE Transactions on Parallel and Distributed Syst...View more

Department of Computer Science and Engineering, Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation, Southern University of Science and Technology, Shenzhen, China
James J. Q. Yu (Senior Member, IEEE) received the B.Eng. and Ph.D. degrees in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 2011 and 2015, respectively.
He is an Assistant Professor with the Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China, and an honorary Assistant Professor with the Department of Electrical and Electroni...Show More
James J. Q. Yu (Senior Member, IEEE) received the B.Eng. and Ph.D. degrees in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 2011 and 2015, respectively.
He is an Assistant Professor with the Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China, and an honorary Assistant Professor with the Department of Electrical and Electroni...View more

Department of Computer Science and Engineering, Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation, Southern University of Science and Technology, Shenzhen, China
Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
Chenhan Zhang (Student Member, IEEE) received the B.Eng. degrees in telecommunication engineering from the University of Wollongong, Wollongong, NSW, Australia and Zhengzhou University, Zhengzhou, China, in 2017 and 2018, respectively, and the M.S. degree in engineering management from the City University of Hong Kong, Hong Kong, in 2019. He is currently pursuing the Ph.D. degree with the Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia.
His research interests include deep learning, intelligent transportation systems, and privacy preserving in AI.
Chenhan Zhang (Student Member, IEEE) received the B.Eng. degrees in telecommunication engineering from the University of Wollongong, Wollongong, NSW, Australia and Zhengzhou University, Zhengzhou, China, in 2017 and 2018, respectively, and the M.S. degree in engineering management from the City University of Hong Kong, Hong Kong, in 2019. He is currently pursuing the Ph.D. degree with the Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia.
His research interests include deep learning, intelligent transportation systems, and privacy preserving in AI.View more

Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
Lei Cui (Member, IEEE) received the Ph.D. degree from Deakin University, Melbourne, VIC, Australia, in 2021.
He has authored or coauthored more than 20 publications, including monographs, book chapters, and journal and conference papers. Some of his publications have been published in the top venues, such as IEEE Transactions on Industrial Informatics, IEEE Transactions on Network and Service Management, and IEEE Transactions on Parallel and Distributed Systems. His research interests include security and privacy issues in IoT, social networks, and machine learning.
Dr. Cui is active in communication society and has served as a reviewer for many Q1 journals and a TPC Member for international conferences.
Lei Cui (Member, IEEE) received the Ph.D. degree from Deakin University, Melbourne, VIC, Australia, in 2021.
He has authored or coauthored more than 20 publications, including monographs, book chapters, and journal and conference papers. Some of his publications have been published in the top venues, such as IEEE Transactions on Industrial Informatics, IEEE Transactions on Network and Service Management, and IEEE Transactions on Parallel and Distributed Systems. His research interests include security and privacy issues in IoT, social networks, and machine learning.
Dr. Cui is active in communication society and has served as a reviewer for many Q1 journals and a TPC Member for international conferences.View more

Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
Shui Yu (Senior Member, IEEE) received the Ph.D. degree from Deakin University, Geelong, VIC, Australia, in 2004.
He is currently a Professor with the School of Computer Science, University of Technology Sydney, Sydney, NSW, Australia. He has published three monographs and edited two books, more than 400 technical papers, including top journals and top conferences, such as IEEE Transactions on Parallel and Distributed Systems, IEEE Transactions on Computers, IEEE Transactions on Information Forensics and Security, IEEE Transactions on Mobile Computing, IEEE Transactions on Knowledge and Data Engineering, IEEE Transactions on Emerging Topics in Computing, IEEE/ACM Transactions on Networking, and INFOCOM. His H-index is 58. His research interest includes big data, security and privacy, networking, and mathematical modeling.
Prof. Yu initiated the research field of networking for big data in 2013, and his research outputs have been widely adopted by industrial systems, such as Amazon cloud security. He is currently serving a number of prestigious editorial boards, including IEEE Communications Surveys and Tutorials (an Area Editor), IEEE Communications Magazine, and IEEE Internet of Things Journal. He is a member of AAAS and ACM, a Distinguished Lecturer of IEEE Communications Society, and an elected member of Board of Governor of IEEE Vehicular Technology Society.
Shui Yu (Senior Member, IEEE) received the Ph.D. degree from Deakin University, Geelong, VIC, Australia, in 2004.
He is currently a Professor with the School of Computer Science, University of Technology Sydney, Sydney, NSW, Australia. He has published three monographs and edited two books, more than 400 technical papers, including top journals and top conferences, such as IEEE Transactions on Parallel and Distributed Systems, IEEE Transactions on Computers, IEEE Transactions on Information Forensics and Security, IEEE Transactions on Mobile Computing, IEEE Transactions on Knowledge and Data Engineering, IEEE Transactions on Emerging Topics in Computing, IEEE/ACM Transactions on Networking, and INFOCOM. His H-index is 58. His research interest includes big data, security and privacy, networking, and mathematical modeling.
Prof. Yu initiated the research field of networking for big data in 2013, and his research outputs have been widely adopted by industrial systems, such as Amazon cloud security. He is currently serving a number of prestigious editorial boards, including IEEE Communications Surveys and Tutorials (an Area Editor), IEEE Communications Magazine, and IEEE Internet of Things Journal. He is a member of AAAS and ACM, a Distinguished Lecturer of IEEE Communications Society, and an elected member of Board of Governor of IEEE Vehicular Technology Society.View more

Department of Computer Science and Engineering, Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation, Southern University of Science and Technology, Shenzhen, China
James J. Q. Yu (Senior Member, IEEE) received the B.Eng. and Ph.D. degrees in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 2011 and 2015, respectively.
He is an Assistant Professor with the Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China, and an honorary Assistant Professor with the Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, where he was a Postdoctoral Fellow from 2015 to 2018. He currently also serves as the Chief Research Consultant of GWGrid Inc., Zhuhai, China and Fano Labs, Hong Kong. His general research interests are in smart city and urban computing, deep learning, intelligent transportation systems, and smart energy systems. His work is now mainly on forecasting and decision making of future transportation systems and basic artificial intelligence techniques for industrial applications.
Dr. Yu was ranked World’s Top 2% Scientists by Stanford University in 2020. He is an Editor of the IET Smart Cities journal.
James J. Q. Yu (Senior Member, IEEE) received the B.Eng. and Ph.D. degrees in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 2011 and 2015, respectively.
He is an Assistant Professor with the Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China, and an honorary Assistant Professor with the Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, where he was a Postdoctoral Fellow from 2015 to 2018. He currently also serves as the Chief Research Consultant of GWGrid Inc., Zhuhai, China and Fano Labs, Hong Kong. His general research interests are in smart city and urban computing, deep learning, intelligent transportation systems, and smart energy systems. His work is now mainly on forecasting and decision making of future transportation systems and basic artificial intelligence techniques for industrial applications.
Dr. Yu was ranked World’s Top 2% Scientists by Stanford University in 2020. He is an Editor of the IET Smart Cities journal.View more