Distributed Q-Learning-Based Voltage Restoration Algorithm in Isolated AC Microgrids Subject to Input Saturation

Shih-Wen Lin,Chia-Chi Chu
DOI: https://doi.org/10.1109/tia.2024.3379965
IF: 4.079
2024-01-01
IEEE Transactions on Industry Applications
Abstract:A model-free data-driven Q-learning-based distributed control is proposed for achieving autonomous voltage restoration in isolated AC microgrids (MGs) subject to input saturation. First, by defining the control objective in terms of local neighborhood tracking errors, the voltage restoration problem can be solved by the distributed pinning-based consensus problem. To address the effect of input signal saturation in each distributed generator (DG), the low gain feedback method is considered to obtain these feedback gains. Since these feedback gain matrices are obtained by solving the modified algebraic Riccati equation (MARE) which needs the complete knowledge of DG dynamics, an iterative model-free data-driven Q-learning algorithm is presented. A Q-learning function and a Q-learning Bellman equation are defined for finding these feedback gain matrices. Finally, based on recursive least square techniques, an iterative Q-learning algorithm is proposed for achieving autonomous voltage restoration. To validate the performance of the proposed method, simulations of two isolated AC MG are performed. Simulation results demonstrate that the acquired feedback gains closely align with these analytical solutions of the MARE. Furthermore, the proposed model-free distributed Q-learning method remains its effectiveness even under model uncertainty and plug-and-play operations of DGs.
engineering, electrical & electronic, multidisciplinary
What problem does this paper attempt to address?