Abstract:This article presents the control of a grid connected PV (GC-PV) array system, starting from a benchmark. The control structure used in this article was a cascade-type structure, in which PI or synergetic (SYN) controllers were used for the inner control loop of id and iq currents and PI or sliding mode control (SMC) controllers were used for the outer control loop of the udc voltage from the DC intermediate circuit. This paper presents the mathematical model of the PV array together with the main component blocks: simulated inputs for the PV array; the PV array itself; the MPPT algorithm; the DC-DC boost converter; the voltage and current measurements for the DC intermediate circuit; the load and connection to power grid; the DC-AC converter; and the power grid. It also presents the stages of building and training the reinforcement learning (RL) agent. To improve the performance of the control system for the GC-PV array system without using controllers with a more complicated mathematical description, the advantages provided by the RL agent on process controls could also be used. This technique does not require exact knowledge of the mathematical model of the controlled system or the type of uncertainties. The improvement in the control system performance for the GC-PV array system, both when using simple PI-type controllers or complex SMC- and SYN-type controllers, was achieved using an RL agent based on the Deep Deterministic Policy Gradient (DDPG). The variant of DDPG used in this study was the Twin-Delayed (TD3). The improvement in performance of the control system were obtained by using the correction command signals provided by the trained RL agent, which were added to the command signals ud, uq and idref. The parametric robustness of the proposed control system based on SMC and SYN controllers for the GC-PV array system was proven in the case of a variation of 30% caused by the three-phase load. Moreover, the results of the numerical simulations are shown comparatively and the validation of the synthesis of the proposed control system was obtained. This was achieved by comparing the proposed system with a software benchmark for the control of a GC-PV array system performed in MATLAB Simulink. The numerical simulations proved the superiority of the performance of control systems that use the RL-TD3 agent.

Reinventing power quality enhancement: deep reinforcement learning control for PV-UPQC in microgrids

Advancing microgrid power quality: integration of GRU-based control in PV-UPQC systems

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

An Improved Power Quality in a Renewable Energy-based Microgrid System Using Adaptive Hybrid UPQC Control Strategy

Coordination of PV Smart Inverters Using Deep Reinforcement Learning for Grid Voltage Regulation

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Comparative Performance of UPQC Control System Based on PI-GWO, Fractional Order Controllers, and Reinforcement Learning Agent

PV Integrated UPQC with Intelligent Control Techniques for Power Quality Enhancement

Design and analysis of UPQC in a microgrid using model reference adaptive control ensemble with back-stepping controller

Control Strategies for Enhancing Power Quality with Unified Power Quality Conditioner in a Solar-PV Integrated Utility System

Deep reinforcement learning approach to estimate the energy-mix proportion for secure operation of converter-dominated power system

Improvement of the Control of a Grid Connected Photovoltaic System Based on Synergetic and Sliding Mode Controllers Using a Reinforcement Learning Deep Deterministic Policy Gradient Agent

Power Quality (PQ) Analyses of DG Utilizing Unified Power Quality Conditioner (UPQC) by White Shark Optimizer and Recalling-Enhanced Recurrent Neural Network

Inverter PQ Control with Trajectory Tracking Capability for Microgrids Based on Physics-informed Reinforcement Learning

Artificial ecosystem optimized neural network controlled unified power quality conditioner for microgrid application

Enactment of Deep Reinforcement Learning Control for Power Management and Enhancement of Voltage Regulation in a DC Micro-Grid System

Dandelion Optimizer-Based Reinforcement Learning Techniques for MPPT of Grid- Connected Photovoltaic Systems

AI-enhanced power quality management in distribution systems: implementing a dual-phase UPQC control with adaptive neural networks and optimized PI controllers

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

ANFIS-based Power Quality Improvement by Photovoltaic Integrated UPQC at Distribution System

Neural Network Controlled Solar PV Battery Powered Unified Power Quality Conditioner for Grid Connected Operation