Near optimal control and network co-design for uncertain networked control system with constraints

Near optimal control and network co-design problem has been investigated for uncertain networked control system (NCS) with limited transmit power in this paper. First, the mathematical connection between network imperfections and practical wireless network channel performance has been investigate. Then, a novel co-model has been represented for NCS combining effects from physical system and network channel model effectively. Then, adopting neuro dynamics programming (NDP) technique and actor-critic-identifier (ACI) design architecture, a novel online finite horizon optimal control and network co-design has been developed. The developed algorithm cannot merely obtain the optimal co-design within finite time, but also relax the stringent requirement about physical system and network dynamics. In addition, developed novel co-design can satisfy the practical constraints, e.g. transmit power constraint. The Lyapunov stability analysis is used to validate the effectiveness of developed scheme. With the proper NN weight update law, proposed scheme can ensure all closed-loop signals and NN weights are uniformly ultimately bounded (UUB). Furthermore, simulation results have been provided to demonstrate the effectiveness of the developed scheme.