Resource Allocation for Metaverse Experience Optimization: A Multi-Objective Multi-Agent Evolutionary Reinforcement Learning Approach | IEEE Journals & Magazine | IEEE Xplore

Resource Allocation for Metaverse Experience Optimization: A Multi-Objective Multi-Agent Evolutionary Reinforcement Learning Approach


Abstract:

In the Metaverse, real-time, concurrent services such as virtual classrooms and immersive gaming require local graphic rendering to maintain low latency. However, the lim...Show More

Abstract:

In the Metaverse, real-time, concurrent services such as virtual classrooms and immersive gaming require local graphic rendering to maintain low latency. However, the limited processing power and battery capacity of user devices make it challenging to balance Quality of Experience (QoE) and terminal energy consumption. In this paper, we investigate a multi-objective optimization problem (MOP) regarding power control and rendering capacity allocation by formulating it as a multi-objective optimization problem. This problem aims to minimize energy consumption while maximizing Meta-Immersion (MI), a metric that integrates objective network performance with subjective user perception. To solve this problem, we propose a Multi-Objective Multi-Agent Evolutionary Reinforcement Learning with User-Object-Attention (M2ERL-UOA) algorithm. The algorithm employs a prediction-driven evolutionary learning mechanism for multi-agents, coupled with optimized rendering capacity decisions for virtual objects. The algorithm can yield a superior Pareto front that attains the Nash equilibrium. Simulation results demonstrate that the proposed algorithm can generate Pareto fronts, effectively adapts to dynamic user preferences, and significantly reduces decision-making time compared to several benchmarks.
Published in: IEEE Transactions on Mobile Computing ( Volume: 24, Issue: 4, April 2025)
Page(s): 3473 - 3488
Date of Publication: 02 December 2024

ISSN Information:

Funding Agency:

Author image of Lei Feng
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Lei Feng (Member, IEEE) received the BEng and PhD degrees in communication and information systems from the Beijing University of Posts and Telecommunications (BUPT), in 2009 and 2015, respectively. He is an associate professor with present with the State Key Laboratory of Networking and Switching Technology, BUPT. His research interests include knowledge-driven next generation networks, 5G time-sensitive network technolo...Show More
Lei Feng (Member, IEEE) received the BEng and PhD degrees in communication and information systems from the Beijing University of Posts and Telecommunications (BUPT), in 2009 and 2015, respectively. He is an associate professor with present with the State Key Laboratory of Networking and Switching Technology, BUPT. His research interests include knowledge-driven next generation networks, 5G time-sensitive network technolo...View more
Author image of Xiaoyi Jiang
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Xiaoyi Jiang received the BE degree from the Beijing University of Posts and Telecommunications, in 2022. He is currently working toward the MS degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. His current research interests include resource allocation and multi-objective multi-agent reinforcement learning.
Xiaoyi Jiang received the BE degree from the Beijing University of Posts and Telecommunications, in 2022. He is currently working toward the MS degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. His current research interests include resource allocation and multi-objective multi-agent reinforcement learning.View more
Author image of Yao Sun
James Watt School of Engineering, University of Glasgow, Glasgow, U.K.
Yao Sun (Senior Member, IEEE) is currently a lecturer with the James Watt School of Engineering, University of Glasgow, Glasgow, U.K. He has won the IEEE Communication Society of TAOS Best Paper Award in 2019 ICC. He has been the guest editor for special issues of several international journals. He has served as TPC chair for UCET 2021, and TPC member for a number of international flagship conferences, including ICC 2022,...Show More
Yao Sun (Senior Member, IEEE) is currently a lecturer with the James Watt School of Engineering, University of Glasgow, Glasgow, U.K. He has won the IEEE Communication Society of TAOS Best Paper Award in 2019 ICC. He has been the guest editor for special issues of several international journals. He has served as TPC chair for UCET 2021, and TPC member for a number of international flagship conferences, including ICC 2022,...View more
Author image of Dusit Niyato
College of Computing and Data Science, Nanyang Technological University, Singapore
Dusit Niyato (Fellow, IEEE) is a professor in the College of Computing and Data Science, at Nanyang Technological University, Singapore. He received B.Eng. from King Mongkuts Institute of Technology Ladkrabang (KMITL), Thailand and Ph.D. in electrical and computer engineering from the University of Manitoba, Canada. His research interests are in the areas of mobile generative AI, edge intelligence, decentralized machine l...Show More
Dusit Niyato (Fellow, IEEE) is a professor in the College of Computing and Data Science, at Nanyang Technological University, Singapore. He received B.Eng. from King Mongkuts Institute of Technology Ladkrabang (KMITL), Thailand and Ph.D. in electrical and computer engineering from the University of Manitoba, Canada. His research interests are in the areas of mobile generative AI, edge intelligence, decentralized machine l...View more
Author image of Yu Zhou
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Yu Zhou received the BE degree from North China Electric Power University, in 2020. She is currently working toward the PhD degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her current research interests include resource allocation, deterministic guarantee mechanisms for industrial wireless networks.
Yu Zhou received the BE degree from North China Electric Power University, in 2020. She is currently working toward the PhD degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her current research interests include resource allocation, deterministic guarantee mechanisms for industrial wireless networks.View more
Author image of Shiyi Gu
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Shiyi Gu received the BEng degree from the University of Shanghai for Science and Technology and Liverpool John Moores University, in 2021. She is currently working toward the PhD degree in computer science and technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her research interests include resource allocation, mobility management, and wire...Show More
Shiyi Gu received the BEng degree from the University of Shanghai for Science and Technology and Liverpool John Moores University, in 2021. She is currently working toward the PhD degree in computer science and technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her research interests include resource allocation, mobility management, and wire...View more
Author image of Zhixiang Yang
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Zhixiang Yang received the BE degree from Beijing Jiaotong University, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. He is currently a post-doctoral researcher with the School of Computer Science, BUPT. His research interests include reconfigurable intelligent surface, backscatter communicaiton, and multiple access technology.
Zhixiang Yang received the BE degree from Beijing Jiaotong University, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. He is currently a post-doctoral researcher with the School of Computer Science, BUPT. His research interests include reconfigurable intelligent surface, backscatter communicaiton, and multiple access technology.View more
Author image of Yang Yang
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Yang Yang received the BEng degree in network engineering from the Beijing Information Science and Technology University (BISTU), China, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. Her research interests include device to device communication, wireless VR multimedia delivery, mobile edge computing, and distributed machine learning.
Yang Yang received the BEng degree in network engineering from the Beijing Information Science and Technology University (BISTU), China, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. Her research interests include device to device communication, wireless VR multimedia delivery, mobile edge computing, and distributed machine learning.View more
Author image of Fanqin Zhou
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Fanqin Zhou (Member, IEEE) received the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), China, in 2019. He is currently a lecturer with the State Key Laboratory of Networking and Switching Technology, BUPT. His current research interests include intelligent network slicing and resource management of mobile edge networks.
Fanqin Zhou (Member, IEEE) received the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), China, in 2019. He is currently a lecturer with the State Key Laboratory of Networking and Switching Technology, BUPT. His current research interests include intelligent network slicing and resource management of mobile edge networks.View more

I. Introduction

The Metaverse is characterized by its immersive nature, allowing seamless integration between physical and virtual experiences, offering users the ability to live, work, and play in a digital environment [1]. For example, hands-on training with immersive simulations enables workers to refine their skills within a risk-free virtual realm [2]. Using virtual classrooms would allow students and teachers to interact in 3D virtual spaces for lectures, discussions, and collaborative activities [3]. Compared to the passive experience of live video streaming, the Metaverse is distinguished by its high level of interactivity. Real-time immersive Metaverse services place rigorous requirements on hardware and software to provide low delay and fast rendering performance. In terms of hardware, lightweight, low-power head-mounted displays (HMDs) and physical assistive devices are required to use high-resolution images for a long time without frequent charging or battery replacement [4]. In terms of software, rising delay adversely affects the user experience, potentially leading to dizziness and motion sickness due to sensory confusion [5]. Due to the limitations in computing power and battery capacity of HMD devices, balancing terminal energy consumption while ensuring immersive user experience and achieving high-quality, low-latency rendering on low-power devices has become an urgent challenge to address.

Author image of Lei Feng
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Lei Feng (Member, IEEE) received the BEng and PhD degrees in communication and information systems from the Beijing University of Posts and Telecommunications (BUPT), in 2009 and 2015, respectively. He is an associate professor with present with the State Key Laboratory of Networking and Switching Technology, BUPT. His research interests include knowledge-driven next generation networks, 5G time-sensitive network technologies for Industrial IoT, and resource management and coordination of mobile networks.
Lei Feng (Member, IEEE) received the BEng and PhD degrees in communication and information systems from the Beijing University of Posts and Telecommunications (BUPT), in 2009 and 2015, respectively. He is an associate professor with present with the State Key Laboratory of Networking and Switching Technology, BUPT. His research interests include knowledge-driven next generation networks, 5G time-sensitive network technologies for Industrial IoT, and resource management and coordination of mobile networks.View more
Author image of Xiaoyi Jiang
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Xiaoyi Jiang received the BE degree from the Beijing University of Posts and Telecommunications, in 2022. He is currently working toward the MS degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. His current research interests include resource allocation and multi-objective multi-agent reinforcement learning.
Xiaoyi Jiang received the BE degree from the Beijing University of Posts and Telecommunications, in 2022. He is currently working toward the MS degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. His current research interests include resource allocation and multi-objective multi-agent reinforcement learning.View more
Author image of Yao Sun
James Watt School of Engineering, University of Glasgow, Glasgow, U.K.
Yao Sun (Senior Member, IEEE) is currently a lecturer with the James Watt School of Engineering, University of Glasgow, Glasgow, U.K. He has won the IEEE Communication Society of TAOS Best Paper Award in 2019 ICC. He has been the guest editor for special issues of several international journals. He has served as TPC chair for UCET 2021, and TPC member for a number of international flagship conferences, including ICC 2022, VTC spring 2022, GLOBECOM 2020, WCNC 2019, ICCT 2019. His research interests include intelligent wireless networking, semantic communications, blockchain system, and resource management in next generation mobile networks.
Yao Sun (Senior Member, IEEE) is currently a lecturer with the James Watt School of Engineering, University of Glasgow, Glasgow, U.K. He has won the IEEE Communication Society of TAOS Best Paper Award in 2019 ICC. He has been the guest editor for special issues of several international journals. He has served as TPC chair for UCET 2021, and TPC member for a number of international flagship conferences, including ICC 2022, VTC spring 2022, GLOBECOM 2020, WCNC 2019, ICCT 2019. His research interests include intelligent wireless networking, semantic communications, blockchain system, and resource management in next generation mobile networks.View more
Author image of Dusit Niyato
College of Computing and Data Science, Nanyang Technological University, Singapore
Dusit Niyato (Fellow, IEEE) is a professor in the College of Computing and Data Science, at Nanyang Technological University, Singapore. He received B.Eng. from King Mongkuts Institute of Technology Ladkrabang (KMITL), Thailand and Ph.D. in electrical and computer engineering from the University of Manitoba, Canada. His research interests are in the areas of mobile generative AI, edge intelligence, decentralized machine learning, and incentive mechanism design.
Dusit Niyato (Fellow, IEEE) is a professor in the College of Computing and Data Science, at Nanyang Technological University, Singapore. He received B.Eng. from King Mongkuts Institute of Technology Ladkrabang (KMITL), Thailand and Ph.D. in electrical and computer engineering from the University of Manitoba, Canada. His research interests are in the areas of mobile generative AI, edge intelligence, decentralized machine learning, and incentive mechanism design.View more
Author image of Yu Zhou
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Yu Zhou received the BE degree from North China Electric Power University, in 2020. She is currently working toward the PhD degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her current research interests include resource allocation, deterministic guarantee mechanisms for industrial wireless networks.
Yu Zhou received the BE degree from North China Electric Power University, in 2020. She is currently working toward the PhD degree in computer science technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her current research interests include resource allocation, deterministic guarantee mechanisms for industrial wireless networks.View more
Author image of Shiyi Gu
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Shiyi Gu received the BEng degree from the University of Shanghai for Science and Technology and Liverpool John Moores University, in 2021. She is currently working toward the PhD degree in computer science and technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her research interests include resource allocation, mobility management, and wireless networked control for the Internet of Things (IoT) within industrial and power systems.
Shiyi Gu received the BEng degree from the University of Shanghai for Science and Technology and Liverpool John Moores University, in 2021. She is currently working toward the PhD degree in computer science and technology with the State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications. Her research interests include resource allocation, mobility management, and wireless networked control for the Internet of Things (IoT) within industrial and power systems.View more
Author image of Zhixiang Yang
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Zhixiang Yang received the BE degree from Beijing Jiaotong University, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. He is currently a post-doctoral researcher with the School of Computer Science, BUPT. His research interests include reconfigurable intelligent surface, backscatter communicaiton, and multiple access technology.
Zhixiang Yang received the BE degree from Beijing Jiaotong University, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. He is currently a post-doctoral researcher with the School of Computer Science, BUPT. His research interests include reconfigurable intelligent surface, backscatter communicaiton, and multiple access technology.View more
Author image of Yang Yang
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Yang Yang received the BEng degree in network engineering from the Beijing Information Science and Technology University (BISTU), China, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. Her research interests include device to device communication, wireless VR multimedia delivery, mobile edge computing, and distributed machine learning.
Yang Yang received the BEng degree in network engineering from the Beijing Information Science and Technology University (BISTU), China, in 2018, and the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), in 2024. Her research interests include device to device communication, wireless VR multimedia delivery, mobile edge computing, and distributed machine learning.View more
Author image of Fanqin Zhou
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
Fanqin Zhou (Member, IEEE) received the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), China, in 2019. He is currently a lecturer with the State Key Laboratory of Networking and Switching Technology, BUPT. His current research interests include intelligent network slicing and resource management of mobile edge networks.
Fanqin Zhou (Member, IEEE) received the PhD degree from the Beijing University of Posts and Telecommunications (BUPT), China, in 2019. He is currently a lecturer with the State Key Laboratory of Networking and Switching Technology, BUPT. His current research interests include intelligent network slicing and resource management of mobile edge networks.View more

Contact IEEE to Subscribe

References

References is not available for this document.