Loading [MathJax]/extensions/MathMenu.js
Dynamic Event-Triggered Reinforcement Learning-Based Consensus Tracking of Nonlinear Multi-Agent Systems | IEEE Journals & Magazine | IEEE Xplore

Dynamic Event-Triggered Reinforcement Learning-Based Consensus Tracking of Nonlinear Multi-Agent Systems


Abstract:

In this paper, we present a novel approach to address the event-triggered optimized consensus tracking control problem in a class of uncertain nonlinear multi-agent syste...Show More

Abstract:

In this paper, we present a novel approach to address the event-triggered optimized consensus tracking control problem in a class of uncertain nonlinear multi-agent systems (MASs). To optimize control performance, we employ an adaptive reinforcement learning (RL) algorithm based on the actor-critic architecture and utilize the backstepping method. The proposed RL-based optimized controller employs a novel event-triggered strategy, dynamically adjusting sampling errors online to reduce communication resource usage and computational complexity through the intermittent transmission of state signals. We establish the boundedness of all signals in the closed-loop MAS through stability analysis using the Lyapunov method, and demonstrate the prevention of Zeno behavior. Numerical simulations of a practical multi-electromechanical system are provided to validate the effectiveness of the proposed scheme.
Page(s): 2120 - 2132
Date of Publication: 22 February 2023

ISSN Information:

Funding Agency:

Author image of Bo Xu
School of Automation, Qingdao University, Qingdao, China
Bo Xu received the B.E. degree in electrical engineering and automation and the M.E. degree in control engineering from Shandong Jianzhu University, Jinan, China, in 2018 and 2021, respectively. He is currently pursuing the Ph.D. degree in system science with Qingdao University, Qingdao, China. His current research interests include large-scale systems, nonlinear control systems, event-triggered control, and adaptive fuzz...Show More
Bo Xu received the B.E. degree in electrical engineering and automation and the M.E. degree in control engineering from Shandong Jianzhu University, Jinan, China, in 2018 and 2021, respectively. He is currently pursuing the Ph.D. degree in system science with Qingdao University, Qingdao, China. His current research interests include large-scale systems, nonlinear control systems, event-triggered control, and adaptive fuzz...View more
Author image of Yuan-Xin Li
College of Science, Liaoning University of Technology, Jinzhou, China
Yuan-Xin Li received the B.S. degree in mathematics and applied mathematics from Qufu Normal University, Jining, China, in 2007, the M.S. degree in computational mathematics from the College of Mathematical Sciences, Dalian University of Technology, Dalian, China, in 2009, and the Ph.D. degree in control theory and control engineering from the College of Information Science and Engineering, Northeastern University, Shenya...Show More
Yuan-Xin Li received the B.S. degree in mathematics and applied mathematics from Qufu Normal University, Jining, China, in 2007, the M.S. degree in computational mathematics from the College of Mathematical Sciences, Dalian University of Technology, Dalian, China, in 2009, and the Ph.D. degree in control theory and control engineering from the College of Information Science and Engineering, Northeastern University, Shenya...View more
Author image of Zhongsheng Hou
School of Automation, Qingdao University, Qingdao, China
Zhongsheng Hou (Fellow, IEEE) received the B.S. and M.S. degrees from the Jilin University of Technology, China, in 1983 and 1988, respectively, and the Ph.D. degree from Northeastern University, China, in 1994. He was a Post-Doctoral Fellow with the Harbin Institute of Technology, China, from 1995 to 1997, and a Visiting Scholar with Yale University, CT, USA, from 2002 to 2003. In 1997, he joined Beijing Jiaotong Univers...Show More
Zhongsheng Hou (Fellow, IEEE) received the B.S. and M.S. degrees from the Jilin University of Technology, China, in 1983 and 1988, respectively, and the Ph.D. degree from Northeastern University, China, in 1994. He was a Post-Doctoral Fellow with the Harbin Institute of Technology, China, from 1995 to 1997, and a Visiting Scholar with Yale University, CT, USA, from 2002 to 2003. In 1997, he joined Beijing Jiaotong Univers...View more
Author image of Choon Ki Ahn
School of Electrical Engineering, Korea University, Seoul, South Korea
Choon Ki Ahn (Senior Member, IEEE) received the B.S. and M.S. degrees from the School of Electrical Engineering, Korea University, Seoul, South Korea, in 2000 and 2002, respectively, and the Ph.D. degree from the School of Electrical Engineering and Computer Science, Seoul National University, Seoul, in 2006. He is currently a crimson Professor in excellence with the College of Engineering and a Full Professor with the Sc...Show More
Choon Ki Ahn (Senior Member, IEEE) received the B.S. and M.S. degrees from the School of Electrical Engineering, Korea University, Seoul, South Korea, in 2000 and 2002, respectively, and the Ph.D. degree from the School of Electrical Engineering and Computer Science, Seoul National University, Seoul, in 2006. He is currently a crimson Professor in excellence with the College of Engineering and a Full Professor with the Sc...View more

Author image of Bo Xu
School of Automation, Qingdao University, Qingdao, China
Bo Xu received the B.E. degree in electrical engineering and automation and the M.E. degree in control engineering from Shandong Jianzhu University, Jinan, China, in 2018 and 2021, respectively. He is currently pursuing the Ph.D. degree in system science with Qingdao University, Qingdao, China. His current research interests include large-scale systems, nonlinear control systems, event-triggered control, and adaptive fuzzy control.
Bo Xu received the B.E. degree in electrical engineering and automation and the M.E. degree in control engineering from Shandong Jianzhu University, Jinan, China, in 2018 and 2021, respectively. He is currently pursuing the Ph.D. degree in system science with Qingdao University, Qingdao, China. His current research interests include large-scale systems, nonlinear control systems, event-triggered control, and adaptive fuzzy control.View more
Author image of Yuan-Xin Li
College of Science, Liaoning University of Technology, Jinzhou, China
Yuan-Xin Li received the B.S. degree in mathematics and applied mathematics from Qufu Normal University, Jining, China, in 2007, the M.S. degree in computational mathematics from the College of Mathematical Sciences, Dalian University of Technology, Dalian, China, in 2009, and the Ph.D. degree in control theory and control engineering from the College of Information Science and Engineering, Northeastern University, Shenyang, China, in 2017. He is currently a Professor with the Liaoning University of Technology, Jinzhou, China. His research interests include adaptive fuzzy/neural control, fault-tolerant control, event-triggered control, and adaptive control of cyber-physical systems.
Yuan-Xin Li received the B.S. degree in mathematics and applied mathematics from Qufu Normal University, Jining, China, in 2007, the M.S. degree in computational mathematics from the College of Mathematical Sciences, Dalian University of Technology, Dalian, China, in 2009, and the Ph.D. degree in control theory and control engineering from the College of Information Science and Engineering, Northeastern University, Shenyang, China, in 2017. He is currently a Professor with the Liaoning University of Technology, Jinzhou, China. His research interests include adaptive fuzzy/neural control, fault-tolerant control, event-triggered control, and adaptive control of cyber-physical systems.View more
Author image of Zhongsheng Hou
School of Automation, Qingdao University, Qingdao, China
Zhongsheng Hou (Fellow, IEEE) received the B.S. and M.S. degrees from the Jilin University of Technology, China, in 1983 and 1988, respectively, and the Ph.D. degree from Northeastern University, China, in 1994. He was a Post-Doctoral Fellow with the Harbin Institute of Technology, China, from 1995 to 1997, and a Visiting Scholar with Yale University, CT, USA, from 2002 to 2003. In 1997, he joined Beijing Jiaotong University, China, where he had been a distinguished Professor and the founding Director of the Advanced Control Systems Laboratory and the Head of the Department of Automatic Control. Currently, he is a Chair Professor with the School of Automation, Qingdao University, Qingdao, China. He is also the founding Director of the Technical Committee on Data Driven Control, Learning and Optimization (DDCLO), Chinese Association of Automation (CAA), and is a fellow of CAA. He is an IFAC Technical Committee Member on both “Adaptive and Learning Systems” and “Transportation Systems.”
Zhongsheng Hou (Fellow, IEEE) received the B.S. and M.S. degrees from the Jilin University of Technology, China, in 1983 and 1988, respectively, and the Ph.D. degree from Northeastern University, China, in 1994. He was a Post-Doctoral Fellow with the Harbin Institute of Technology, China, from 1995 to 1997, and a Visiting Scholar with Yale University, CT, USA, from 2002 to 2003. In 1997, he joined Beijing Jiaotong University, China, where he had been a distinguished Professor and the founding Director of the Advanced Control Systems Laboratory and the Head of the Department of Automatic Control. Currently, he is a Chair Professor with the School of Automation, Qingdao University, Qingdao, China. He is also the founding Director of the Technical Committee on Data Driven Control, Learning and Optimization (DDCLO), Chinese Association of Automation (CAA), and is a fellow of CAA. He is an IFAC Technical Committee Member on both “Adaptive and Learning Systems” and “Transportation Systems.”View more
Author image of Choon Ki Ahn
School of Electrical Engineering, Korea University, Seoul, South Korea
Choon Ki Ahn (Senior Member, IEEE) received the B.S. and M.S. degrees from the School of Electrical Engineering, Korea University, Seoul, South Korea, in 2000 and 2002, respectively, and the Ph.D. degree from the School of Electrical Engineering and Computer Science, Seoul National University, Seoul, in 2006. He is currently a crimson Professor in excellence with the College of Engineering and a Full Professor with the School of Electrical Engineering, Korea University.
He was a recipient of the Early Career Research Award of Korea University in 2015. In 2016, he was ranked #1 in electrical/electronic engineering among Korean young professors based on research quality. In 2017, he received the Presidential Young Scientist Award from the President of South Korea. In 2020, he received the Outstanding Associate Editor Award for IEEE Transactions on Neural Networks and Learning Systems. In 2021, he received the Best Associate Editor Award for IEEE Transactions on Systems, Man, and Cybernetics: Systems. In 2019 and 2022, he received the Research Excellence Award from Korea University (Top 3% Professor of Korea University in Research). He was a recipient of the (2019–2022) Highly Cited Researcher Award in Engineering by Clarivate Analytics (formerly, Thomson Reuters). He has been a Senior Editor of IEEE Transactions on Neural Networks and Learning Systems, a Senior Associate Editor of IEEE Systems Journal, and an Associate Editor of IEEE Transactions on Fuzzy Systems; IEEE Transactions on Systems, Man, and Cybernetics: Systems; IEEE Transactions on Automation Science and Engineering; IEEE Transactions on Intelligent Transportation Systems; IEEE Transactions on Circuits and Systems— I: Regular Papers; IEEE Systems, Man, and Cybernetics Magazine; Nonlinear Dynamics; Aerospace Science and Technology; and other flagship journals.
Choon Ki Ahn (Senior Member, IEEE) received the B.S. and M.S. degrees from the School of Electrical Engineering, Korea University, Seoul, South Korea, in 2000 and 2002, respectively, and the Ph.D. degree from the School of Electrical Engineering and Computer Science, Seoul National University, Seoul, in 2006. He is currently a crimson Professor in excellence with the College of Engineering and a Full Professor with the School of Electrical Engineering, Korea University.
He was a recipient of the Early Career Research Award of Korea University in 2015. In 2016, he was ranked #1 in electrical/electronic engineering among Korean young professors based on research quality. In 2017, he received the Presidential Young Scientist Award from the President of South Korea. In 2020, he received the Outstanding Associate Editor Award for IEEE Transactions on Neural Networks and Learning Systems. In 2021, he received the Best Associate Editor Award for IEEE Transactions on Systems, Man, and Cybernetics: Systems. In 2019 and 2022, he received the Research Excellence Award from Korea University (Top 3% Professor of Korea University in Research). He was a recipient of the (2019–2022) Highly Cited Researcher Award in Engineering by Clarivate Analytics (formerly, Thomson Reuters). He has been a Senior Editor of IEEE Transactions on Neural Networks and Learning Systems, a Senior Associate Editor of IEEE Systems Journal, and an Associate Editor of IEEE Transactions on Fuzzy Systems; IEEE Transactions on Systems, Man, and Cybernetics: Systems; IEEE Transactions on Automation Science and Engineering; IEEE Transactions on Intelligent Transportation Systems; IEEE Transactions on Circuits and Systems— I: Regular Papers; IEEE Systems, Man, and Cybernetics Magazine; Nonlinear Dynamics; Aerospace Science and Technology; and other flagship journals.View more

Contact IEEE to Subscribe

References

References is not available for this document.