Abstract:
To enable the large scale and efficient deployment of Artificial Intelligence (AI), the confluence of AI and Edge Computing has given rise to Edge Intelligence, which lev...Show MoreMetadata
Abstract:
To enable the large scale and efficient deployment of Artificial Intelligence (AI), the confluence of AI and Edge Computing has given rise to Edge Intelligence, which leverages on the computation and communication capabilities of end devices and edge servers to process data closer to where it is produced. One of the enabling technologies of Edge Intelligence is the privacy preserving machine learning paradigm known as Federated Learning (FL), which enables data owners to conduct model training without having to transmit their raw data to third-party servers. However, the FL network is envisioned to involve thousands of heterogeneous distributed devices. As a result, communication inefficiency remains a key bottleneck. To reduce node failures and device dropouts, the Hierarchical Federated Learning (HFL) framework has been proposed whereby cluster heads are designated to support the data owners through intermediate model aggregation. This decentralized learning approach reduces the reliance on a central controller, e.g., the model owner. However, the issues of resource allocation and incentive design are not well-studied in the HFL framework. In this article, we consider a two-level resource allocation and incentive mechanism design problem. In the lower level, the cluster heads offer rewards in exchange for the data owners' participation, and the data owners are free to choose which cluster to join. Specifically, we apply the evolutionary game theory to model the dynamics of the cluster selection process. In the upper level, each cluster head can choose to serve a model owner, whereas the model owners have to compete amongst each other for the services of the cluster heads. As such, we propose a deep learning based auction mechanism to derive the valuation of each cluster head's services. The performance evaluation shows the uniqueness and stability of our proposed evolutionary game, as well as the revenue maximizing properties of the deep learning based auction.
Published in: IEEE Transactions on Parallel and Distributed Systems ( Volume: 33, Issue: 3, 01 March 2022)
Funding Agency:
Alibaba Group and Alibaba-NTU Joint Research Institute (JRI), Nanyang Technological University (NTU), Singapore, Singapore
Wei Yang Bryan Lim graduated with two First-Class Honors in economics and business administration (finance) from the National University of Singapore (NUS). He is currently working toward an Alibaba Talent Programme PhD degree with Alibaba-NTU Joint Research Institute, Nanyang Technological University (NTU), Singapore. During his PhD candidature, he was the recipient of 2 best paper awards in the IEEE Wireless Communicati...Show More
Wei Yang Bryan Lim graduated with two First-Class Honors in economics and business administration (finance) from the National University of Singapore (NUS). He is currently working toward an Alibaba Talent Programme PhD degree with Alibaba-NTU Joint Research Institute, Nanyang Technological University (NTU), Singapore. During his PhD candidature, he was the recipient of 2 best paper awards in the IEEE Wireless Communicati...View more
Alibaba Group and Alibaba-NTU Joint Research Institute (JRI), Nanyang Technological University (NTU), Singapore, Singapore
Jer Shyuan Ng graduated with Double (Honours) in electrical engineering (highest distinction) and economics from the National University of Singapore in 2019. She is currently working toward an Alibaba PhD degree with the Alibaba Group and Alibaba-NTU Joint Research Institute, Nanyang Technological University, Singapore. Her research interests include incentive mechanisms and edge computing.
Jer Shyuan Ng graduated with Double (Honours) in electrical engineering (highest distinction) and economics from the National University of Singapore in 2019. She is currently working toward an Alibaba PhD degree with the Alibaba Group and Alibaba-NTU Joint Research Institute, Nanyang Technological University, Singapore. Her research interests include incentive mechanisms and edge computing.View more
Information Systems Technology and Design (ISTD) Pillar, Singapore University of Technology and Design, Singapore, Singapore
Zehui Xiong (Member, IEEE) received the PhD degree from Nanyang Technological University, Singapore. He is currently an assistant professor with the Pillar of Information Systems Technology and Design, Singapore University of Technology and Design. Prior to that, he was a researcher with Alibaba-NTU Joint Research Institute, Singapore. He was the visiting scholar with Princeton University and the University of Waterloo. H...Show More
Zehui Xiong (Member, IEEE) received the PhD degree from Nanyang Technological University, Singapore. He is currently an assistant professor with the Pillar of Information Systems Technology and Design, Singapore University of Technology and Design. Prior to that, he was a researcher with Alibaba-NTU Joint Research Institute, Singapore. He was the visiting scholar with Princeton University and the University of Waterloo. H...View more
TuSimple, Beijing 100016, China
Jiangming Jin (Member, IEEE) received the bachelor's degree from the University of Electronic Science and Technology of China in 2008, and the PhD degree in computer engineering from Nanyang Technological University in Singapore, in 2013. He started his career with J. P. Morgan (Singapore & Beijing). In J. P. Morgan, he was with the most sophisticated and large-scale financial computing system and was also with JPM Credit...Show More
Jiangming Jin (Member, IEEE) received the bachelor's degree from the University of Electronic Science and Technology of China in 2008, and the PhD degree in computer engineering from Nanyang Technological University in Singapore, in 2013. He started his career with J. P. Morgan (Singapore & Beijing). In J. P. Morgan, he was with the most sophisticated and large-scale financial computing system and was also with JPM Credit...View more
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
Yang Zhang (Member, IEEE) received the BEng and MEng degrees from the Beijing University of Aeronautics and Astronautics (Beihang University) in 2008 and 2011, respectively, and the PhD degree in computer engineering from Nanyang Technological University, Singapore, in 2015. He is currently an associate professor with the College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, China...Show More
Yang Zhang (Member, IEEE) received the BEng and MEng degrees from the Beijing University of Aeronautics and Astronautics (Beihang University) in 2008 and 2011, respectively, and the PhD degree in computer engineering from Nanyang Technological University, Singapore, in 2015. He is currently an associate professor with the College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, China...View more
School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore, Singapore
Dusit Niyato (Fellow, IEEE) received the BE degree from the King Mongkuk's Institute of Technology Ladkrabang (KMITL), Thailand, in 1999, and the PhD degree in electrical and computer engineering from the University of Manitoba, Canada, in 2008. He is currently a professor with the School of Computer Science and Engineering and, by courtesy, the School of Physical & Mathematical Sciences, Nanyang Technological University,...Show More
Dusit Niyato (Fellow, IEEE) received the BE degree from the King Mongkuk's Institute of Technology Ladkrabang (KMITL), Thailand, in 1999, and the PhD degree in electrical and computer engineering from the University of Manitoba, Canada, in 2008. He is currently a professor with the School of Computer Science and Engineering and, by courtesy, the School of Physical & Mathematical Sciences, Nanyang Technological University,...View more
Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), Singapore, Singapore
Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, Canada
Cyril Leung received the BSc (First Class Hons.) degree from Imperial College, University of London, U.K., and the MS and PhD degrees in electrical engineering from Stanford University. He has been an assistant professor with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, and with the Department of Systems Engineering and Computing Science, Carleton University. Since ...Show More
Cyril Leung received the BSc (First Class Hons.) degree from Imperial College, University of London, U.K., and the MS and PhD degrees in electrical engineering from Stanford University. He has been an assistant professor with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, and with the Department of Systems Engineering and Computing Science, Carleton University. Since ...View more
SCSE, Nanyang Technological University (NTU), Singapore, Singapore
LILY, Alibaba-NTU JRI, Singapore, Singapore
Chunyan Miao received the BS degree from Shandong University, Jinan, China, in 1988, and the MS and PhD degrees from Nanyang Technological University (NTU), Singapore, in 1998 and 2003, respectively. She is currently a professor with the School of Computer Science and NTU, and the director of Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY). Her research interest includes infusing intell...Show More
Chunyan Miao received the BS degree from Shandong University, Jinan, China, in 1988, and the MS and PhD degrees from Nanyang Technological University (NTU), Singapore, in 1998 and 2003, respectively. She is currently a professor with the School of Computer Science and NTU, and the director of Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY). Her research interest includes infusing intell...View more
Contents Alibaba Group and Alibaba-NTU Joint Research Institute (JRI), Nanyang Technological University (NTU), Singapore, Singapore
Wei Yang Bryan Lim graduated with two First-Class Honors in economics and business administration (finance) from the National University of Singapore (NUS). He is currently working toward an Alibaba Talent Programme PhD degree with Alibaba-NTU Joint Research Institute, Nanyang Technological University (NTU), Singapore. During his PhD candidature, he was the recipient of 2 best paper awards in the IEEE Wireless Communications and Networking Conference (WCNC) and ACM Mobicom-Dronecom workshop. He is a regular reviewer of the leading journals and flagship conferences and is currently the assistant of editor-in-chief of IEEE Communications Surveys & Tutorials.
Wei Yang Bryan Lim graduated with two First-Class Honors in economics and business administration (finance) from the National University of Singapore (NUS). He is currently working toward an Alibaba Talent Programme PhD degree with Alibaba-NTU Joint Research Institute, Nanyang Technological University (NTU), Singapore. During his PhD candidature, he was the recipient of 2 best paper awards in the IEEE Wireless Communications and Networking Conference (WCNC) and ACM Mobicom-Dronecom workshop. He is a regular reviewer of the leading journals and flagship conferences and is currently the assistant of editor-in-chief of IEEE Communications Surveys & Tutorials.View more
Alibaba Group and Alibaba-NTU Joint Research Institute (JRI), Nanyang Technological University (NTU), Singapore, Singapore
Jer Shyuan Ng graduated with Double (Honours) in electrical engineering (highest distinction) and economics from the National University of Singapore in 2019. She is currently working toward an Alibaba PhD degree with the Alibaba Group and Alibaba-NTU Joint Research Institute, Nanyang Technological University, Singapore. Her research interests include incentive mechanisms and edge computing.
Jer Shyuan Ng graduated with Double (Honours) in electrical engineering (highest distinction) and economics from the National University of Singapore in 2019. She is currently working toward an Alibaba PhD degree with the Alibaba Group and Alibaba-NTU Joint Research Institute, Nanyang Technological University, Singapore. Her research interests include incentive mechanisms and edge computing.View more
Information Systems Technology and Design (ISTD) Pillar, Singapore University of Technology and Design, Singapore, Singapore
Zehui Xiong (Member, IEEE) received the PhD degree from Nanyang Technological University, Singapore. He is currently an assistant professor with the Pillar of Information Systems Technology and Design, Singapore University of Technology and Design. Prior to that, he was a researcher with Alibaba-NTU Joint Research Institute, Singapore. He was the visiting scholar with Princeton University and the University of Waterloo. He has authored or coauthored more than 100 research papers in leading journals and flagship conferences and five of them are ESI Highly Cited Papers. His research interests include wireless communications, network games and economics, blockchain, and edge intelligence. He was the recipient of five best paper awards in international conferences and technical committee. He is currently the editor or guest editor for many leading journals including IEEE JSAC, IoTJ, TNSE, and TCCN. He was the recipient of Chinese Government Award for Outstanding Students Abroad in 2019 and NTU SCSE Best PhD Thesis Runner-Up Award in 2020. He is the founding vice chair of the Special Interest Group on Wireless Blockchain Networks in the IEEE Cognitive Networks Technical Committee.
Zehui Xiong (Member, IEEE) received the PhD degree from Nanyang Technological University, Singapore. He is currently an assistant professor with the Pillar of Information Systems Technology and Design, Singapore University of Technology and Design. Prior to that, he was a researcher with Alibaba-NTU Joint Research Institute, Singapore. He was the visiting scholar with Princeton University and the University of Waterloo. He has authored or coauthored more than 100 research papers in leading journals and flagship conferences and five of them are ESI Highly Cited Papers. His research interests include wireless communications, network games and economics, blockchain, and edge intelligence. He was the recipient of five best paper awards in international conferences and technical committee. He is currently the editor or guest editor for many leading journals including IEEE JSAC, IoTJ, TNSE, and TCCN. He was the recipient of Chinese Government Award for Outstanding Students Abroad in 2019 and NTU SCSE Best PhD Thesis Runner-Up Award in 2020. He is the founding vice chair of the Special Interest Group on Wireless Blockchain Networks in the IEEE Cognitive Networks Technical Committee.View more
TuSimple, Beijing 100016, China
Jiangming Jin (Member, IEEE) received the bachelor's degree from the University of Electronic Science and Technology of China in 2008, and the PhD degree in computer engineering from Nanyang Technological University in Singapore, in 2013. He started his career with J. P. Morgan (Singapore & Beijing). In J. P. Morgan, he was with the most sophisticated and large-scale financial computing system and was also with JPM Credit Portfolio Group in credit derivative calculations. He began a venture journey in autonomous driving with TuSimple (NASDAQ: TSP) in 2017. In TuSimple, he was successively a director of HPC and a senior expert of Engineering to oversee projects of high-performance robotic middleware and heterogeneous computing systems. He has authored or coauthored more than 20 research papers in top conferences/journals and applied more than ten U.S./CN patents in the areas of his research interests, which include hi-tech areas including fintech, AI chips and software, big data and machine learning systems, 5G, and IoT. He was a session-chair or the keynotespeaker in several AI Summits/Forums. He also holds several advisory positions in universities and non-profit institutes such as, Shanghai Tech University, Tianjin University, and Shenzhen Fintech Association. He is an executive member of CCF-TCHPC and CCF-TCARCH.
Jiangming Jin (Member, IEEE) received the bachelor's degree from the University of Electronic Science and Technology of China in 2008, and the PhD degree in computer engineering from Nanyang Technological University in Singapore, in 2013. He started his career with J. P. Morgan (Singapore & Beijing). In J. P. Morgan, he was with the most sophisticated and large-scale financial computing system and was also with JPM Credit Portfolio Group in credit derivative calculations. He began a venture journey in autonomous driving with TuSimple (NASDAQ: TSP) in 2017. In TuSimple, he was successively a director of HPC and a senior expert of Engineering to oversee projects of high-performance robotic middleware and heterogeneous computing systems. He has authored or coauthored more than 20 research papers in top conferences/journals and applied more than ten U.S./CN patents in the areas of his research interests, which include hi-tech areas including fintech, AI chips and software, big data and machine learning systems, 5G, and IoT. He was a session-chair or the keynotespeaker in several AI Summits/Forums. He also holds several advisory positions in universities and non-profit institutes such as, Shanghai Tech University, Tianjin University, and Shenzhen Fintech Association. He is an executive member of CCF-TCHPC and CCF-TCARCH.View more
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
Yang Zhang (Member, IEEE) received the BEng and MEng degrees from the Beijing University of Aeronautics and Astronautics (Beihang University) in 2008 and 2011, respectively, and the PhD degree in computer engineering from Nanyang Technological University, Singapore, in 2015. He is currently an associate professor with the College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, China. He is currenlty an associate editor for the EURASIP Journal on Wireless Communications and Networking, and a technical committee member of Computer Communications.
Yang Zhang (Member, IEEE) received the BEng and MEng degrees from the Beijing University of Aeronautics and Astronautics (Beihang University) in 2008 and 2011, respectively, and the PhD degree in computer engineering from Nanyang Technological University, Singapore, in 2015. He is currently an associate professor with the College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, China. He is currenlty an associate editor for the EURASIP Journal on Wireless Communications and Networking, and a technical committee member of Computer Communications.View more
School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore, Singapore
Dusit Niyato (Fellow, IEEE) received the BE degree from the King Mongkuk's Institute of Technology Ladkrabang (KMITL), Thailand, in 1999, and the PhD degree in electrical and computer engineering from the University of Manitoba, Canada, in 2008. He is currently a professor with the School of Computer Science and Engineering and, by courtesy, the School of Physical & Mathematical Sciences, Nanyang Technological University, Singapore. He has authored or coauthored more than 380 technical papers in the area of wireless and mobile networking, and is an inventor of four U.S. and German patents. He has authored four books including Game Theory in Wireless and Communication Networks: Theory, Models, and Applications (Cambridge University Press). He was the recipient of Best Young Researcher Award of the IEEE Communications Society (ComSoc) Asia Pacific (AP) and 2011 IEEE Communications Society Fred W. Ellersick Prize Paper Award. He is currently a senior editor of the IEEE Wireless Communications Letter, an area editor of IEEE Transactions on Wireless Communications (Radio Management and Multiple Access) and IEEE Communications Surveys and Tutorials (Network and Service Management and Green Communication), an editor of IEEE Transactions on Communications, an associate editor for IEEE Transactions on Mobile Computing, IEEE Transactions on Vehicular Technology, and the IEEE Transactions on Cognitive Communications and Networking. He was a guest editor of IEEE Journal on Selected Areas on Communications. He was a distinguished lecturer of Communications Society for 2016–2017. He was named the 2017, 2018, 2019 highly cited researcher in computer science.
Dusit Niyato (Fellow, IEEE) received the BE degree from the King Mongkuk's Institute of Technology Ladkrabang (KMITL), Thailand, in 1999, and the PhD degree in electrical and computer engineering from the University of Manitoba, Canada, in 2008. He is currently a professor with the School of Computer Science and Engineering and, by courtesy, the School of Physical & Mathematical Sciences, Nanyang Technological University, Singapore. He has authored or coauthored more than 380 technical papers in the area of wireless and mobile networking, and is an inventor of four U.S. and German patents. He has authored four books including Game Theory in Wireless and Communication Networks: Theory, Models, and Applications (Cambridge University Press). He was the recipient of Best Young Researcher Award of the IEEE Communications Society (ComSoc) Asia Pacific (AP) and 2011 IEEE Communications Society Fred W. Ellersick Prize Paper Award. He is currently a senior editor of the IEEE Wireless Communications Letter, an area editor of IEEE Transactions on Wireless Communications (Radio Management and Multiple Access) and IEEE Communications Surveys and Tutorials (Network and Service Management and Green Communication), an editor of IEEE Transactions on Communications, an associate editor for IEEE Transactions on Mobile Computing, IEEE Transactions on Vehicular Technology, and the IEEE Transactions on Cognitive Communications and Networking. He was a guest editor of IEEE Journal on Selected Areas on Communications. He was a distinguished lecturer of Communications Society for 2016–2017. He was named the 2017, 2018, 2019 highly cited researcher in computer science.View more
Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), Singapore, Singapore
Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, Canada
Cyril Leung received the BSc (First Class Hons.) degree from Imperial College, University of London, U.K., and the MS and PhD degrees in electrical engineering from Stanford University. He has been an assistant professor with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, and with the Department of Systems Engineering and Computing Science, Carleton University. Since 1980, he has been with the Department of Electrical and Computer Engineering, The University of British Columbia (UBC), Vancouver, Canada, where he is currently a professor and holds the PMC-Sierra Professorship in Networking and Communications. He was an associate dean of research and graduate studies with the Faculty of Applied Science, UBC, from 2008 to 2011. His research interests include wireless communication systems, data security, and technologies to support ageless aging for the elderly. He is a member of the Association of Professional Engineers, and Geoscientists of British Columbia, Canada.
Cyril Leung received the BSc (First Class Hons.) degree from Imperial College, University of London, U.K., and the MS and PhD degrees in electrical engineering from Stanford University. He has been an assistant professor with the Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, and with the Department of Systems Engineering and Computing Science, Carleton University. Since 1980, he has been with the Department of Electrical and Computer Engineering, The University of British Columbia (UBC), Vancouver, Canada, where he is currently a professor and holds the PMC-Sierra Professorship in Networking and Communications. He was an associate dean of research and graduate studies with the Faculty of Applied Science, UBC, from 2008 to 2011. His research interests include wireless communication systems, data security, and technologies to support ageless aging for the elderly. He is a member of the Association of Professional Engineers, and Geoscientists of British Columbia, Canada.View more
SCSE, Nanyang Technological University (NTU), Singapore, Singapore
LILY, Alibaba-NTU JRI, Singapore, Singapore
Chunyan Miao received the BS degree from Shandong University, Jinan, China, in 1988, and the MS and PhD degrees from Nanyang Technological University (NTU), Singapore, in 1998 and 2003, respectively. She is currently a professor with the School of Computer Science and NTU, and the director of Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY). Her research interest includes infusing intelligent agents into interactive new media (virtual, mixed, mobile, and pervasive media) to create novel experiences and dimensions in game design, interactive narrative, and other real world agent systems.
Chunyan Miao received the BS degree from Shandong University, Jinan, China, in 1988, and the MS and PhD degrees from Nanyang Technological University (NTU), Singapore, in 1998 and 2003, respectively. She is currently a professor with the School of Computer Science and NTU, and the director of Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY). Her research interest includes infusing intelligent agents into interactive new media (virtual, mixed, mobile, and pervasive media) to create novel experiences and dimensions in game design, interactive narrative, and other real world agent systems.View more
