Finite horizon optimal control and communication co-design for uncertain networked control system with transmit power constraint

In this paper, finite horizon optimal control and communication co-design problem has been investigated for uncertain networked control system (NCS) with limited transmit power. Firstly, the mathematical relation between network imperfections (e.g. network-induced delays and packet dropouts) and practical wireless communication channel quality has been studied. Then, a novel networked control system model has been represented that includes both physical system dynamics and network dynamics. Next, adopting the emerging neuro dynamics programming (NDP) technique and actor-critic-identifier (ACI) architecture, a novel time-based finite horizon optimal control and communication co-design has been proposed. The proposed scheme cannot only learn the optimal co-design within fixed final time, but also relax the requirement of NCS dynamics and satisfy the practical transmit power constraint. The Lyapunov Theorem is used to validate the effectiveness of proposed scheme. With the proper NN weight update law, proposed scheme can ensure all closed-loop signals and NN weights are uniformly ultimately bounded (UUB). Moreover, simulation results are also included to demonstrate the effectiveness of the proposed scheme.