Cognitive Control Using Adaptive RBF Neural Networks and Reinforcement Learning for Networked Control System Subject to Time-Varying Delay and Packet Losses

Wang Shuti,Yin Xunhe,Li Peng,Zhang Yanxin,Wang Xin,Tong Shujie
DOI: https://doi.org/10.1007/s13369-021-05752-y
IF: 2.807
2021-01-01
Arabian Journal for Science and Engineering
Abstract:This paper proposes a novel cognitive control strategy for overcoming the impacts of time-varying delay and data packet losses in networked control system. The Bernoulli distribution is used to characterize the packet losses and time-varying delay. Then, the information entropy is employed for computing the corresponding uncertainties and describe the information gap in the cognitive control. With Q-learning, PID and adaptive RBF neural networks, an improved cognitive control is designed, which is composed of three sub-controllers, i.e., cognitive controller A, PID controller and cognitive controller B. Cognitive controller A is designed with Q-learning, and cognitive controller B is designed by blending adaptive RBF neural networks with Q-learning. For an extensive analysis, the presented control methodology is compared to Q-learning-PID. The simulations show that the proposed cognitive control scheme has better robustness to packet losses and time delay than Q-learning-PID.
What problem does this paper attempt to address?