Abstract:
In mobile edge computing (MEC) systems, unmanned aerial vehicles (UAVs) facilitate edge service providers (ESPs) offering flexible resource provisioning with broader comm...Show MoreMetadata
Abstract:
In mobile edge computing (MEC) systems, unmanned aerial vehicles (UAVs) facilitate edge service providers (ESPs) offering flexible resource provisioning with broader communication coverage and thus improving the Quality of Service (QoS). However, dynamic system states and various traffic patterns seriously hinder efficient cooperation among UAVs. Existing solutions commonly rely on prior system knowledge or complex neural network models, lacking adaptability and causing excessive overheads. To address these critical challenges, we propose the DisOff, a novel profit-aware cooperative offloading framework in UAV-enabled MEC with lightweight deep reinforcement learning (DRL). First, we design an improved DRL with twin critic-networks and delay mechanism, which solves the Q -value overestimation and high variance and thus approximates the optimal UAV cooperative offloading and resource allocation. Next, we develop a new multiteacher distillation mechanism for the proposed DRL model, where the policies of multiple UAVs are integrated into one DRL agent, compressing the model size while maintaining superior performance. Using the real-world datasets of user traffic, extensive experiments are conducted to validate the effectiveness of the proposed DisOff. Compared to benchmark methods, the DisOff enhances ESP profits while reducing the DRL model size and training costs.
Published in: IEEE Internet of Things Journal ( Volume: 11, Issue: 12, 15 June 2024)
Funding Agency:
College of Computer and Data Science and the Fujian Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, China
Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou, China
Zheyi Chen (Member, IEEE) received the Ph.D. degree in computer science from the University of Exeter, Exeter, U.K., in 2021, and the M.Sc. degree in computer science and technology from Tsinghua University, Beijing, China, in 2017.
He is a Professor and a Qishan Scholar with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His research interests include cloud-edge computing, resource optimizatio...Show More
Zheyi Chen (Member, IEEE) received the Ph.D. degree in computer science from the University of Exeter, Exeter, U.K., in 2021, and the M.Sc. degree in computer science and technology from Tsinghua University, Beijing, China, in 2017.
He is a Professor and a Qishan Scholar with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His research interests include cloud-edge computing, resource optimizatio...View more
College of Computer and Data Science and the Fujian Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, China
Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou, China
Junjie Zhang received the B.S. degree in computer science from Anhui Agricultural University, Hefei, China, in 2022. He is currently pursuing the M.S. degree in computer science with the College of Computer and Data Science, Fuzhou University, Fuzhou, China.
His current research interests include mobile edge computing, network slicing, and reinforcement learning.
Junjie Zhang received the B.S. degree in computer science from Anhui Agricultural University, Hefei, China, in 2022. He is currently pursuing the M.S. degree in computer science with the College of Computer and Data Science, Fuzhou University, Fuzhou, China.
His current research interests include mobile edge computing, network slicing, and reinforcement learning.View more
College of Computer and Data Science and the Fujian Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, China
Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou, China
Xianghan Zheng received the M.Sc. degree in distributed system and the Ph.D. degree in information communication technology from the University of Agder, Kristiansand, Norway, in 2007 and 2011, respectively.
He is currently a Professor with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His current research interests include new generation network with a special focus on cloud computing service...Show More
Xianghan Zheng received the M.Sc. degree in distributed system and the Ph.D. degree in information communication technology from the University of Agder, Kristiansand, Norway, in 2007 and 2011, respectively.
He is currently a Professor with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His current research interests include new generation network with a special focus on cloud computing service...View more
Department of Computer Science, Faculty of Environment, Science and Economy, University of Exeter, Exeter, U.K.
Geyong Min (Member, IEEE) received the B.Sc. degree in computer science from Huazhong University of Science and Technology, Wuhan, China, in 1995, and the Ph.D. degree in computing science from the University of Glasgow, Glasgow, U.K., in 2003.
He is a Professor of High Performance Computing and Networking with the Department of Computer Science, Faculty of Environment, Science and Economy, University of Exeter, Exeter, U....Show More
Geyong Min (Member, IEEE) received the B.Sc. degree in computer science from Huazhong University of Science and Technology, Wuhan, China, in 1995, and the Ph.D. degree in computing science from the University of Glasgow, Glasgow, U.K., in 2003.
He is a Professor of High Performance Computing and Networking with the Department of Computer Science, Faculty of Environment, Science and Economy, University of Exeter, Exeter, U....View more
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
Jie Li (Fellow, IEEE) received the B.E. degree in computer science from Zhejiang University, Hangzhou, China, the M.E. degree in electronic engineering and communication systems from China Academy of Posts and Telecommunications, Beijing, China, and the Dr.Eng. degree from the University of Electro-Communications, Tokyo, Japan.
He is with the Department of Computer Science and Engineering, Shanghai Jiao Tong University, Sh...Show More
Jie Li (Fellow, IEEE) received the B.E. degree in computer science from Zhejiang University, Hangzhou, China, the M.E. degree in electronic engineering and communication systems from China Academy of Posts and Telecommunications, Beijing, China, and the Dr.Eng. degree from the University of Electro-Communications, Tokyo, Japan.
He is with the Department of Computer Science and Engineering, Shanghai Jiao Tong University, Sh...View more
Department of Electronic Engineering and Computer Science, University of Stavanger, Stavanger, Norway
Chunming Rong (Senior Member, IEEE) received the B.S., M.Sc., and Ph.D. degrees in computer science from the University of Bergen, Bergen, Norway, in 1993, 1995, and 1998, respectively.
He has been an Academician of the Norwegian Academy of Technological Sciences, Trondheim, Norway, since 2011. He is also an Advisor of the StandICT.EU to support European scandalization activities in ICT. He works as the Head of the Data-Ce...Show More
Chunming Rong (Senior Member, IEEE) received the B.S., M.Sc., and Ph.D. degrees in computer science from the University of Bergen, Bergen, Norway, in 1993, 1995, and 1998, respectively.
He has been an Academician of the Norwegian Academy of Technological Sciences, Trondheim, Norway, since 2011. He is also an Advisor of the StandICT.EU to support European scandalization activities in ICT. He works as the Head of the Data-Ce...View more
Contents College of Computer and Data Science and the Fujian Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, China
Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou, China
Zheyi Chen (Member, IEEE) received the Ph.D. degree in computer science from the University of Exeter, Exeter, U.K., in 2021, and the M.Sc. degree in computer science and technology from Tsinghua University, Beijing, China, in 2017.
He is a Professor and a Qishan Scholar with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His research interests include cloud-edge computing, resource optimization, deep learning, and reinforcement learning. He has published over 20 research papers in reputable international journals and conferences, such as IEEE Transactions on Parallel and Distributed Systems, IEEE Transactions on Industrial Informatics, IEEE Communications Magazine, IEEE Transactions on Cloud Computing, IEEE Internet of Things Journal, and IEEE ICC.
Zheyi Chen (Member, IEEE) received the Ph.D. degree in computer science from the University of Exeter, Exeter, U.K., in 2021, and the M.Sc. degree in computer science and technology from Tsinghua University, Beijing, China, in 2017.
He is a Professor and a Qishan Scholar with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His research interests include cloud-edge computing, resource optimization, deep learning, and reinforcement learning. He has published over 20 research papers in reputable international journals and conferences, such as IEEE Transactions on Parallel and Distributed Systems, IEEE Transactions on Industrial Informatics, IEEE Communications Magazine, IEEE Transactions on Cloud Computing, IEEE Internet of Things Journal, and IEEE ICC.View more
College of Computer and Data Science and the Fujian Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, China
Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou, China
Junjie Zhang received the B.S. degree in computer science from Anhui Agricultural University, Hefei, China, in 2022. He is currently pursuing the M.S. degree in computer science with the College of Computer and Data Science, Fuzhou University, Fuzhou, China.
His current research interests include mobile edge computing, network slicing, and reinforcement learning.
Junjie Zhang received the B.S. degree in computer science from Anhui Agricultural University, Hefei, China, in 2022. He is currently pursuing the M.S. degree in computer science with the College of Computer and Data Science, Fuzhou University, Fuzhou, China.
His current research interests include mobile edge computing, network slicing, and reinforcement learning.View more
College of Computer and Data Science and the Fujian Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, China
Engineering Research Center of Big Data Intelligence, Ministry of Education, Fuzhou, China
Xianghan Zheng received the M.Sc. degree in distributed system and the Ph.D. degree in information communication technology from the University of Agder, Kristiansand, Norway, in 2007 and 2011, respectively.
He is currently a Professor with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His current research interests include new generation network with a special focus on cloud computing services and applications, and big data processing and security.
Xianghan Zheng received the M.Sc. degree in distributed system and the Ph.D. degree in information communication technology from the University of Agder, Kristiansand, Norway, in 2007 and 2011, respectively.
He is currently a Professor with the College of Computer and Data Science, Fuzhou University, Fuzhou, China. His current research interests include new generation network with a special focus on cloud computing services and applications, and big data processing and security.View more
Department of Computer Science, Faculty of Environment, Science and Economy, University of Exeter, Exeter, U.K.
Geyong Min (Member, IEEE) received the B.Sc. degree in computer science from Huazhong University of Science and Technology, Wuhan, China, in 1995, and the Ph.D. degree in computing science from the University of Glasgow, Glasgow, U.K., in 2003.
He is a Professor of High Performance Computing and Networking with the Department of Computer Science, Faculty of Environment, Science and Economy, University of Exeter, Exeter, U.K. His research interests include future Internet, computer networks, wireless communications, multimedia systems, information security, high-performance computing, ubiquitous computing, modeling, and performance engineering.
Geyong Min (Member, IEEE) received the B.Sc. degree in computer science from Huazhong University of Science and Technology, Wuhan, China, in 1995, and the Ph.D. degree in computing science from the University of Glasgow, Glasgow, U.K., in 2003.
He is a Professor of High Performance Computing and Networking with the Department of Computer Science, Faculty of Environment, Science and Economy, University of Exeter, Exeter, U.K. His research interests include future Internet, computer networks, wireless communications, multimedia systems, information security, high-performance computing, ubiquitous computing, modeling, and performance engineering.View more
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
Jie Li (Fellow, IEEE) received the B.E. degree in computer science from Zhejiang University, Hangzhou, China, the M.E. degree in electronic engineering and communication systems from China Academy of Posts and Telecommunications, Beijing, China, and the Dr.Eng. degree from the University of Electro-Communications, Tokyo, Japan.
He is with the Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China, where he is a Chair Professor. His current research interests are in big data and AI, blockchain, edge computing, networking and security, OS, and information system architecture. He serves as the Director of the Shanghai Jiao Tong University Blockchain Research Centre. He was a Professor with the Department of Computer Science, University of Tsukuba, Tsukuba, Japan. He was a Visiting Professor with Yale University, New Haven, CT, USA; Inria Sophia Antipolis, Biot, France; and Inria Grenoble-Rhone-Aples, Montbonnot-Saint-Martin, France.
Dr. Li is the Co-Chair of IEEE Technical Community on Big Data and the Founding Chair of IEEE ComSoc Technical Committee on Big Data. He serves as an associate editor for many IEEE journals and transactions. He has also served on the program committees for several international conferences.
Jie Li (Fellow, IEEE) received the B.E. degree in computer science from Zhejiang University, Hangzhou, China, the M.E. degree in electronic engineering and communication systems from China Academy of Posts and Telecommunications, Beijing, China, and the Dr.Eng. degree from the University of Electro-Communications, Tokyo, Japan.
He is with the Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China, where he is a Chair Professor. His current research interests are in big data and AI, blockchain, edge computing, networking and security, OS, and information system architecture. He serves as the Director of the Shanghai Jiao Tong University Blockchain Research Centre. He was a Professor with the Department of Computer Science, University of Tsukuba, Tsukuba, Japan. He was a Visiting Professor with Yale University, New Haven, CT, USA; Inria Sophia Antipolis, Biot, France; and Inria Grenoble-Rhone-Aples, Montbonnot-Saint-Martin, France.
Dr. Li is the Co-Chair of IEEE Technical Community on Big Data and the Founding Chair of IEEE ComSoc Technical Committee on Big Data. He serves as an associate editor for many IEEE journals and transactions. He has also served on the program committees for several international conferences.View more
Department of Electronic Engineering and Computer Science, University of Stavanger, Stavanger, Norway
Chunming Rong (Senior Member, IEEE) received the B.S., M.Sc., and Ph.D. degrees in computer science from the University of Bergen, Bergen, Norway, in 1993, 1995, and 1998, respectively.
He has been an Academician of the Norwegian Academy of Technological Sciences, Trondheim, Norway, since 2011. He is also an Advisor of the StandICT.EU to support European scandalization activities in ICT. He works as the Head of the Data-Centered and Secure Computing, University of Stavanger, Stavanger, Norway. He was an Adjunct Senior Scientist leading Big-Data Initiative with NORCE (2016–2019) and the Vice President of CSA Norway Chapter (2016–2017). He has extensive contact network and projects in both the industry and academic. His research work focuses on cloud computing, data analytics, cyber security, and blockchain. He has extensive experience in managing large-scale research and development projects, both in Norway and EU.
Prof. Rong is also a Co-Founder of two start-ups bitYoga and Dataunitor in Norway, both received the EU Seal of Excellence Award in 2018. He has served the extended IEEE Cloud Computing Community for many years. Starting the CloudCom Conference series in 2009, he gave numerous keynote addresses with IEEE conferences all over the world. He played a vital leadership role (first as a Vice Chair and then as a Chair) in both the IEEE Cloud Computing initiative and the IEEE CS STC Cloud Computing, and led its Transition to the IEEE CS Technical Committee on Cloud Computing. He served as the Steering Chair (2016–2019), and currently as a Steering Member of the IEEE Transactions on Cloud Computing. He has extended his engagement also in the IEEE Future Directions, through his involvement with the IEEE Blockchain Initiative (2017–2018). He is an Executive Member of Technical Consortium on High Performance Computing and the Chair of STC on Blockchain in IEEE Computer Society. He is a Co-Editor-in-Chief of the journal Blockchain: Research and Applications (Elsevier), a Co-Editor-in-Chief of the Journal of Cloud Computing (ISSN: 2192-113X) (Springer), has served as the Steering Chair (2016–2019), and a Steering Member and an Associate Editor of the IEEE Transactions on Cloud Computing since 2016.
Chunming Rong (Senior Member, IEEE) received the B.S., M.Sc., and Ph.D. degrees in computer science from the University of Bergen, Bergen, Norway, in 1993, 1995, and 1998, respectively.
He has been an Academician of the Norwegian Academy of Technological Sciences, Trondheim, Norway, since 2011. He is also an Advisor of the StandICT.EU to support European scandalization activities in ICT. He works as the Head of the Data-Centered and Secure Computing, University of Stavanger, Stavanger, Norway. He was an Adjunct Senior Scientist leading Big-Data Initiative with NORCE (2016–2019) and the Vice President of CSA Norway Chapter (2016–2017). He has extensive contact network and projects in both the industry and academic. His research work focuses on cloud computing, data analytics, cyber security, and blockchain. He has extensive experience in managing large-scale research and development projects, both in Norway and EU.
Prof. Rong is also a Co-Founder of two start-ups bitYoga and Dataunitor in Norway, both received the EU Seal of Excellence Award in 2018. He has served the extended IEEE Cloud Computing Community for many years. Starting the CloudCom Conference series in 2009, he gave numerous keynote addresses with IEEE conferences all over the world. He played a vital leadership role (first as a Vice Chair and then as a Chair) in both the IEEE Cloud Computing initiative and the IEEE CS STC Cloud Computing, and led its Transition to the IEEE CS Technical Committee on Cloud Computing. He served as the Steering Chair (2016–2019), and currently as a Steering Member of the IEEE Transactions on Cloud Computing. He has extended his engagement also in the IEEE Future Directions, through his involvement with the IEEE Blockchain Initiative (2017–2018). He is an Executive Member of Technical Consortium on High Performance Computing and the Chair of STC on Blockchain in IEEE Computer Society. He is a Co-Editor-in-Chief of the journal Blockchain: Research and Applications (Elsevier), a Co-Editor-in-Chief of the Journal of Cloud Computing (ISSN: 2192-113X) (Springer), has served as the Steering Chair (2016–2019), and a Steering Member and an Associate Editor of the IEEE Transactions on Cloud Computing since 2016.View more
