Loading [a11y]/accessibility-menu.js
Multi-Agent Reinforcement Learning Trajectory Design and Two-Stage Resource Management in CoMP UAV VLC Networks | IEEE Journals & Magazine | IEEE Xplore

Multi-Agent Reinforcement Learning Trajectory Design and Two-Stage Resource Management in CoMP UAV VLC Networks

DatasetsAvailable

Abstract:

In this paper, we consider unmanned aerial vehicles (UAVs) equipped with a visible light communication (VLC) access point and coordinated multipoint (CoMP) capability tha...Show More

Abstract:

In this paper, we consider unmanned aerial vehicles (UAVs) equipped with a visible light communication (VLC) access point and coordinated multipoint (CoMP) capability that allows users to connect to more than one UAV. UAVs can move in 3-dimensional (3D) at a constant acceleration, where a central server is responsible for synchronization and cooperation among UAVs. The effect of accelerated movement in UAV is necessary to be considered. Unlike most existing works, we examine the effects of variable speed on kinetics and radio resource allocations. For the proposed system model, we define two different time scales. In the frame, the acceleration of each UAV is specified, and in each slot, radio resources are allocated. Our goal is to formulate a multi-objective optimization problem where the total data rate is maximized, and the total communication power consumption is minimized simultaneously. To handle this multi-objective optimization, we first apply the scalarization method and then apply multi-agent deep deterministic policy gradient (MADDPG). We improve this solution method by adding two critic networks together with two-stage resource allocation.
Published in: IEEE Transactions on Communications ( Volume: 70, Issue: 11, November 2022)
Page(s): 7464 - 7476
Date of Publication: 04 October 2022

ISSN Information:

Funding Agency:

Author image of Mohammad Reza Maleki
Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran
Mohammad Reza Maleki received the B.Sc. degree in electrical engineering from Tabriz University and the M.Sc. degree in electrical engineering from Tarbiat Moders University, Tehran, Iran. In his current position, he is working as a Research Assistant with Tarbiat Modares University. Predominantly, his research interests are in wireless communications, radio resource allocation, UAV trajectory design, and VLC networks.
Mohammad Reza Maleki received the B.Sc. degree in electrical engineering from Tabriz University and the M.Sc. degree in electrical engineering from Tarbiat Moders University, Tehran, Iran. In his current position, he is working as a Research Assistant with Tarbiat Modares University. Predominantly, his research interests are in wireless communications, radio resource allocation, UAV trajectory design, and VLC networks.View more
Author image of Mohammad Robat Mili
Pasargad Institute for Advanced Innovative Solutions (PIAIS), Tehran, Iran
Mohammad Robat Mili received the Ph.D. degree in electrical and electronic engineering from the University of Manchester, U.K., in 2012. He held postdoctoral research positions at the Department of Telecommunications and Information Processing, Ghent University, Belgium and the Department of Electrical Engineering, Sharif University of Technology, Iran. His main research interests are in the area of design and analysis of...Show More
Mohammad Robat Mili received the Ph.D. degree in electrical and electronic engineering from the University of Manchester, U.K., in 2012. He held postdoctoral research positions at the Department of Telecommunications and Information Processing, Ghent University, Belgium and the Department of Electrical Engineering, Sharif University of Technology, Iran. His main research interests are in the area of design and analysis of...View more
Author image of Mohammad Reza Javan
Department of Electrical Engineering, Shahrood University of Technology, Shahrood, Iran
Mohammad Reza Javan (Senior Member, IEEE) received the B.Sc. degree in electrical engineering from Shahid Beheshti University, Tehran, Iran, in 2003, the M.Sc. degree in electrical engineering from the Sharif University of Technology, Tehran, in 2006, and the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, in 2013. At present, he is a Faculty Member of the Department of Electrical Engineeri...Show More
Mohammad Reza Javan (Senior Member, IEEE) received the B.Sc. degree in electrical engineering from Shahid Beheshti University, Tehran, Iran, in 2003, the M.Sc. degree in electrical engineering from the Sharif University of Technology, Tehran, in 2006, and the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, in 2013. At present, he is a Faculty Member of the Department of Electrical Engineeri...View more
Author image of Nader Mokari
Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran
Nader Mokari (Senior Member, IEEE) received the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, Iran, in 2014. He joined the Department of Electrical and Computer Engineering, Tarbiat Modares University, as an Assistant Professor, in October 2015. He has been elected as an IEEE Exemplary Reviewer in 2016 by IEEE Communications Society. He is currently an Associated Professor with the Depart...Show More
Nader Mokari (Senior Member, IEEE) received the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, Iran, in 2014. He joined the Department of Electrical and Computer Engineering, Tarbiat Modares University, as an Assistant Professor, in October 2015. He has been elected as an IEEE Exemplary Reviewer in 2016 by IEEE Communications Society. He is currently an Associated Professor with the Depart...View more
Author image of Eduard A. Jorswieck
Institute of Communications Technology, TU Braunschweig, Braunschweig, Germany
Eduard A. Jorswieck (Fellow, IEEE) is currently the Managing Director of the Institute of Communications Technology, the Head of the Chair for Communications Systems, and a Full Professor at Technische Universitaet Braunschweig, Brunswick, Germany. From 2008 to 2019, he was the Head of the Chair of Communications Theory and a Full Professor at TU Dresden, Germany. His main research interests are in the broad area of commu...Show More
Eduard A. Jorswieck (Fellow, IEEE) is currently the Managing Director of the Institute of Communications Technology, the Head of the Chair for Communications Systems, and a Full Professor at Technische Universitaet Braunschweig, Brunswick, Germany. From 2008 to 2019, he was the Head of the Chair of Communications Theory and a Full Professor at TU Dresden, Germany. His main research interests are in the broad area of commu...View more

Author image of Mohammad Reza Maleki
Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran
Mohammad Reza Maleki received the B.Sc. degree in electrical engineering from Tabriz University and the M.Sc. degree in electrical engineering from Tarbiat Moders University, Tehran, Iran. In his current position, he is working as a Research Assistant with Tarbiat Modares University. Predominantly, his research interests are in wireless communications, radio resource allocation, UAV trajectory design, and VLC networks.
Mohammad Reza Maleki received the B.Sc. degree in electrical engineering from Tabriz University and the M.Sc. degree in electrical engineering from Tarbiat Moders University, Tehran, Iran. In his current position, he is working as a Research Assistant with Tarbiat Modares University. Predominantly, his research interests are in wireless communications, radio resource allocation, UAV trajectory design, and VLC networks.View more
Author image of Mohammad Robat Mili
Pasargad Institute for Advanced Innovative Solutions (PIAIS), Tehran, Iran
Mohammad Robat Mili received the Ph.D. degree in electrical and electronic engineering from the University of Manchester, U.K., in 2012. He held postdoctoral research positions at the Department of Telecommunications and Information Processing, Ghent University, Belgium and the Department of Electrical Engineering, Sharif University of Technology, Iran. His main research interests are in the area of design and analysis of wireless communication networks with particular focus on 5G and 6G cellular networks using mathematical methods such as optimization theory, game theory, and machine learning
Mohammad Robat Mili received the Ph.D. degree in electrical and electronic engineering from the University of Manchester, U.K., in 2012. He held postdoctoral research positions at the Department of Telecommunications and Information Processing, Ghent University, Belgium and the Department of Electrical Engineering, Sharif University of Technology, Iran. His main research interests are in the area of design and analysis of wireless communication networks with particular focus on 5G and 6G cellular networks using mathematical methods such as optimization theory, game theory, and machine learningView more
Author image of Mohammad Reza Javan
Department of Electrical Engineering, Shahrood University of Technology, Shahrood, Iran
Mohammad Reza Javan (Senior Member, IEEE) received the B.Sc. degree in electrical engineering from Shahid Beheshti University, Tehran, Iran, in 2003, the M.Sc. degree in electrical engineering from the Sharif University of Technology, Tehran, in 2006, and the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, in 2013. At present, he is a Faculty Member of the Department of Electrical Engineering, Shahrood University, Shahrood, Iran. His research interests include design and analysis of wireless communication networks with emphasis on the application of optimization theory.
Mohammad Reza Javan (Senior Member, IEEE) received the B.Sc. degree in electrical engineering from Shahid Beheshti University, Tehran, Iran, in 2003, the M.Sc. degree in electrical engineering from the Sharif University of Technology, Tehran, in 2006, and the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, in 2013. At present, he is a Faculty Member of the Department of Electrical Engineering, Shahrood University, Shahrood, Iran. His research interests include design and analysis of wireless communication networks with emphasis on the application of optimization theory.View more
Author image of Nader Mokari
Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran
Nader Mokari (Senior Member, IEEE) received the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, Iran, in 2014. He joined the Department of Electrical and Computer Engineering, Tarbiat Modares University, as an Assistant Professor, in October 2015. He has been elected as an IEEE Exemplary Reviewer in 2016 by IEEE Communications Society. He is currently an Associated Professor with the Department of Electrical and Computer Engineering, Tarbiat Modares University. His research interests cover many aspects of wireless technologies with a special emphasis on wireless networks. In recent years, his research has been funded by Iranian Mobile Telecommunication Companies, Iranian National Science Foundation (INSF). His thesis received the IEEE Outstanding Ph.D. Thesis Award. He received the Best Paper Award at ITU K-2020. He was also involved in a number of large scale network design and consulting projects in the telecom industry. He is on the Editorial Board of the IEEE Transactions on Communications.
Nader Mokari (Senior Member, IEEE) received the Ph.D. degree in electrical engineering from Tarbiat Modares University, Tehran, Iran, in 2014. He joined the Department of Electrical and Computer Engineering, Tarbiat Modares University, as an Assistant Professor, in October 2015. He has been elected as an IEEE Exemplary Reviewer in 2016 by IEEE Communications Society. He is currently an Associated Professor with the Department of Electrical and Computer Engineering, Tarbiat Modares University. His research interests cover many aspects of wireless technologies with a special emphasis on wireless networks. In recent years, his research has been funded by Iranian Mobile Telecommunication Companies, Iranian National Science Foundation (INSF). His thesis received the IEEE Outstanding Ph.D. Thesis Award. He received the Best Paper Award at ITU K-2020. He was also involved in a number of large scale network design and consulting projects in the telecom industry. He is on the Editorial Board of the IEEE Transactions on Communications.View more
Author image of Eduard A. Jorswieck
Institute of Communications Technology, TU Braunschweig, Braunschweig, Germany
Eduard A. Jorswieck (Fellow, IEEE) is currently the Managing Director of the Institute of Communications Technology, the Head of the Chair for Communications Systems, and a Full Professor at Technische Universitaet Braunschweig, Brunswick, Germany. From 2008 to 2019, he was the Head of the Chair of Communications Theory and a Full Professor at TU Dresden, Germany. His main research interests are in the broad area of communications. He has published some 150 journal papers, 15 book chapters, three monographs, and 300 conference papers on these topics. In 2006, he received the IEEE Signal Processing Society Best Paper Award. Since 2017, he serves as an Editor-in-Chief of the EURASIP Journal on Wireless Communications and Networking. He currently serves as an Editor for IEEE Transactions on Communications. He has served on the Editorial Boards for IEEE Transactions on Signal Processing, IEEE Transactions on Wireless Communications, IEEE Signal Processing Letters, and IEEE Transactions on Information Forensics and Security.
Eduard A. Jorswieck (Fellow, IEEE) is currently the Managing Director of the Institute of Communications Technology, the Head of the Chair for Communications Systems, and a Full Professor at Technische Universitaet Braunschweig, Brunswick, Germany. From 2008 to 2019, he was the Head of the Chair of Communications Theory and a Full Professor at TU Dresden, Germany. His main research interests are in the broad area of communications. He has published some 150 journal papers, 15 book chapters, three monographs, and 300 conference papers on these topics. In 2006, he received the IEEE Signal Processing Society Best Paper Award. Since 2017, he serves as an Editor-in-Chief of the EURASIP Journal on Wireless Communications and Networking. He currently serves as an Editor for IEEE Transactions on Communications. He has served on the Editorial Boards for IEEE Transactions on Signal Processing, IEEE Transactions on Wireless Communications, IEEE Signal Processing Letters, and IEEE Transactions on Information Forensics and Security.View more

Contact IEEE to Subscribe

References

References is not available for this document.