Abstract:This article presents the control of a grid connected PV (GC-PV) array system, starting from a benchmark. The control structure used in this article was a cascade-type structure, in which PI or synergetic (SYN) controllers were used for the inner control loop of id and iq currents and PI or sliding mode control (SMC) controllers were used for the outer control loop of the udc voltage from the DC intermediate circuit. This paper presents the mathematical model of the PV array together with the main component blocks: simulated inputs for the PV array; the PV array itself; the MPPT algorithm; the DC-DC boost converter; the voltage and current measurements for the DC intermediate circuit; the load and connection to power grid; the DC-AC converter; and the power grid. It also presents the stages of building and training the reinforcement learning (RL) agent. To improve the performance of the control system for the GC-PV array system without using controllers with a more complicated mathematical description, the advantages provided by the RL agent on process controls could also be used. This technique does not require exact knowledge of the mathematical model of the controlled system or the type of uncertainties. The improvement in the control system performance for the GC-PV array system, both when using simple PI-type controllers or complex SMC- and SYN-type controllers, was achieved using an RL agent based on the Deep Deterministic Policy Gradient (DDPG). The variant of DDPG used in this study was the Twin-Delayed (TD3). The improvement in performance of the control system were obtained by using the correction command signals provided by the trained RL agent, which were added to the command signals ud, uq and idref. The parametric robustness of the proposed control system based on SMC and SYN controllers for the GC-PV array system was proven in the case of a variation of 30% caused by the three-phase load. Moreover, the results of the numerical simulations are shown comparatively and the validation of the synthesis of the proposed control system was obtained. This was achieved by comparing the proposed system with a software benchmark for the control of a GC-PV array system performed in MATLAB Simulink. The numerical simulations proved the superiority of the performance of control systems that use the RL-TD3 agent.

Reinforcement learning robust nonlinear control of a microgrid with hybrid energy storage systems

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Resilient Reinforcement Learning for Voltage Control in an Islanded DC Microgrid Integrating Data-Driven Piezoelectric

Automatic generation control of is-landed micro-grid using integral reinforcement learning-based adaptive optimal control strategy

Lifelong Control of Off-grid Microgrid with Model Based Reinforcement Learning

Hybrid Energy Storage Control Method For DC Microgrid Based On Deep Deterministic Policy Gradient

Artificial neural network based conditional controllers with saturated action for multi-renewable hybrid alternating or direct current microgrids in islanded and grid-connected modes

Assessing Stability in Renewable Microgrid Using a Novel-Optimized Controller for PVBattery Based Micro Grid with Opal-RT-Based Real-Time Validation

Artificial intelligence-based nonlinear control of renewable energies and storage system in a DC microgrid

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Global Sliding-Mode Control with Fractional-Order Terms for the Robust Optimal Operation of a Hybrid Renewable Microgrid with Battery Energy Storage

Resilient Control of Networked Microgrids using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Reinforcement Learning for Joint Design and Control of Battery-PV Systems

A robust adaptive load frequency control for micro-grids

Hybrid Control of the DC Microgrid Using Deep Neural Networks and Global Terminal Sliding Mode Control with the Exponential Reaching Law

Improvement of the Control of a Grid Connected Photovoltaic System Based on Synergetic and Sliding Mode Controllers Using a Reinforcement Learning Deep Deterministic Policy Gradient Agent

Model-Based Reinforcement Learning Method for Microgrid Optimization Scheduling

Role of redox flow battery and AI-based controller in frequency regulation of weak microgrids

Reinforcement Learning$\unicode{x2013}$Based Transient Response Shaping for Microgrids

Reinforcement Learning for Energy Management of an Islanded Microgrid: Analysis of State, State Space and Reinforcement Function

Hierarchical control combined with higher order sliding mode control for integrating wind/tidal/battery/hydrogen powered DC offshore microgrid