Abstract:On the issues of global environment protection, the renewable energy systems have been widely considered. The photovoltaic (PV) system converts solar power into electricity and significantly reduces the consumption of fossil fuels from environment pollution. Besides introducing new materials for the solar cells to improve the energy conversion efficiency, the maximum power point tracking (MPPT) algorithms have been developed to ensure the efficient operation of PV systems at the maximum power point (MPP) under various weather conditions. The integration of reinforcement learning and deep learning, named deep reinforcement learning (DRL), is proposed in this paper as a future tool to deal with the optimization control problems. Following the success of deep reinforcement learning (DRL) in several fields, the deep Q network (DQN) and deep deterministic policy gradient (DDPG) are proposed to harvest the MPP in PV systems, especially under a partial shading condition (PSC). Different from the reinforcement learning (RL)-based method, which is only operated with discrete state and action spaces, the methods adopted in this paper are used to deal with continuous state spaces. In this study,DQN solves the problem with discrete action spaces, while DDPG handles the continuous action spaces. The proposed methods are simulated in MATLAB/Simulink for feasibility analysis. Further tests under various input conditions with comparisons to the classical Perturb and observe (P&O) MPPT method are carried out for validation. Based on the simulation results in this study, the performance of the proposed methods is outstanding and efficient, showing its potential for further applications.

Research on Optimal Control Strategy of Distributed Photovoltaic Based on Deep Reinforcement Learning

Research on Volt/Var Control of Distribution Networks Based on PPO Algorithm

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Design of photovoltaic-energy storage-load forecasting and optimal control method for distributed distribution network based on reinforcement learning

Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique

Fully Decentralized Reinforcement Learning-based Control of Photovoltaics in Distribution Grids for Joint Provision of Real and Reactive Power

Two-Stage Multi-Mode Voltage Control for Distribution Networks: A Deep Reinforcement Learning Approach Based on Multiple Intelligences

Reinforcement Learning-based District Cooling System Control for Voltage Regulation in Distribution Networks.

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Coordinated Voltage Control in Smart Distribution Network

A Deep Reinforcement Learning-Based MPPT Control for PV Systems under Partial Shading Condition

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

Data-Efficient Deep Reinforcement Learning-Based Optimal Generation Control in DC Microgrids

A Control Strategy Based on Deep Reinforcement Learning Under the Combined Wind-Solar Storage System

Fair Reinforcement Learning Algorithm for PV Active Control in LV Distribution Networks

Research on Decision-Making for New Power Systems under the Virtual Power Plant Mechanism

Model-free voltage control of active distribution system with PVs using surrogate model-based deep reinforcement learning

Double Deep Q-learning Based Real-Time Optimization Strategy for Microgrids