Abstract:The propagation of distributed renewable energy resources poses several challenges in the operation of microgrids due to uncertainty. In traditional energy scheduling approaches, the scheduling algorithm often depends on accurate forecasts of the uncertainties, which in many cases add complexities to the problem. While several data-driven algorithms have been demonstrated to overcome the aforementioned challenges, these methods work better only if the action space is finite. However, the action space for most of the real world problems is continuous making these methods unsuitable for practical applications. To address these issues, this paper proposes a purely data-driven and policy-based approach called Proximal Policy Optimization (PPO) that adopts Reinforcement Learning (RL) to determine the optimal schedule of the energy mix in a hybrid renewable energy system (HRES), with a case study on the highly energy-intensive chlor-alkali process. We implement PPO, an Advantage Actor-Critic RL method that enables samples to be trained for multiple epochs of mini-batch updates to effectively distribute energy among the HRES without having access to the dynamics of the system. To combat the increased grid dependency of a highly energy-intensive process and achieve profitability, a grid-connected HRES network consisting of solar photovoltaic panels, wind turbines, and fuel cells is considered to deliver power to the chlor-alkali process. Simulation results demonstrate an optimal power dispatch among the available power sources with an overall economic cost saving of around 32.8% and corresponding carbon emission reduction of around 28.5% by adopting a HRES as compared to only grid connected system. This framework can generally be used in any data-driven scheduling problems taking advantages of its model-free property.

Real-Time Scheduling of High-Penetrated Renewable Power Systems: an Expert Knowledge and Reinforcement Learning Hybrid Approach

Real-time scheduling of renewable power systems through planning-based reinforcement learning

Real-Time Scheduling Method Based on Deep Reinforcement Learning for a Hybrid Wind-Solar-Storage Energy Generation System

Learning-based scheduling of industrial hybrid renewable energy systems

Real-time Power Scheduling Through Reinforcement Learning from Demonstrations

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

Deep Reinforcement Learning-Based Scheduling Optimization of a Wind-solar Coupled CHP Unit System Considering Source-load Uncertainty

Real-Time Optimal Power Flow Method Via Safe Deep Reinforcement Learning Based on Primal-Dual and Prior Knowledge Guidance

A Deep-Reinforcement-Learning-based Optimal Scheduling for Rural Integrated Energy System Considering the Uncertainties of Renewable Energies and Loads

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Real-time optimization of large-scale hydrogen production systems using off-grid renewable energy: Scheduling strategy based on deep reinforcement learning

Power balance control of RES integrated power system by deep reinforcement learning with optimized utilization rate of renewable energy

Optimal Scheduling of Isolated Microgrids Using Automated Reinforcement Learning-Based Multi-Period Forecasting

Intelligent Scheduling of Wind-Solar-Hydro-Battery Complementary System Based on Deep Reinforcement Learning

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

Deep Reinforcement Learning Based Energy Scheduling of a Hybrid Electricity/Heat/Hydrogen Energy System

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

A New Power System Active Rescheduling Method Considering the Dispatchable Plug-in Electric Vehicles and Intermittent Renewable Energies

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Real-time Sequential Security-Constrained Optimal Power Flow: A Hybrid Knowledge-Data-Driven Reinforcement Learning Approach

Research on Data-Driven Optimal Scheduling of Power System