Intelligent event-based output feedback control with Q-learning for unmanned marine vehicle systems

Dan Zhang,ZeHua Ye,PengCheng Chen,Qing-Guo Wang
DOI: https://doi.org/10.1016/j.conengprac.2020.104616
IF: 4.057
2020-12-01
Control Engineering Practice
Abstract:<p>This paper addresses the Dynamic Output Feedback Control (DOFC) problem for the network-based unmanned marine vehicle (UMV) systems, where the controller is located at the land-based console. The output measurements on the system are transmitted to the land-based console via a communication network. A novel event-based transmission mechanism is devised to alleviate the communication burden, where the threshold of the event function is intelligently updated by a Q-learning algorithm. Since the communication delay is inevitably present in the networked controller design, a time-delay system model is established which incorporates both event-based transmission and communication delay. With help of the Lyapunov stability theory and the extended reciprocally convex matrix inequality approach, a sufficient condition is obtained which ensures asymptotic stability of the tracking error system while a prescribed <span class="math"><math>H∞</math></span> disturbance attenuation performance is met. Finally, the simulation study on a benchmark system shows that the proposed controller design not only attenuates the Yaw Velocity (YV) error variation and the Yaw Angle (YA) oscillation, but also reduces the communication load effectively. Compared with the existing results in literature, it is shown that the proposed control algorithm can provide a better tracking performance.</p>
automation & control systems,engineering, electrical & electronic
What problem does this paper attempt to address?