Abstract:This paper proposes a decision-making approach for the control of distribution systems with distributed energy resources (DERs) equipped with photovoltaic (PV) units and battery energy storage systems (BESS). The objective is to minimize the total operational cost of the distribution system while satisfying the system operating constraints. The method is based on the discrete-time finite-horizon Markov Decision Process (MDP) framework. Different aspects of the operation of the distribution system operation are considered, such as the possibilities of curtailment of PV generation, managing battery storage, reactive power injection, load shedding, and providing a flexibility service for the transmission system. The model is tested for the IEEE 33-bus system with two added DERs and the study cases involve various unexpected events. The experimental results show that this method enables the attainment of relatively low total cost values compared to the reference deterministic approach. The benefits of applying this approach are particularly evident when there is a significant difference between the predicted and actual PV power generation.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper aims to address the control issues of distribution systems that include Distributed Energy Resources (DERS), particularly those equipped with Photovoltaic (PV) units and Battery Energy Storage Systems (BESS). The specific goal is to minimize the total operational cost of the distribution system through optimized decision-making methods while satisfying the system's operational constraints. ### Background and Challenges One of the main challenges faced by modern power systems is the integration of renewable energy sources, such as PV systems. Although distributed renewable energy generation can reduce net power demand and power losses, its high uncertainty can affect grid reliability, leading to issues such as voltage fluctuations. Additionally, extreme weather conditions (e.g., lightning, wildfires, floods, snow, or dust cover) and operational failures (e.g., ground faults or inverter failures) can also lead to the reduction or interruption of renewable energy. ### Solution To address these challenges, the authors propose a decision-making method based on a discrete-time finite-horizon Markov Decision Process (MDP). This method considers various aspects of distribution system operation, including: 1. **PV Generation Curtailment**: Reducing the generation of PV systems when necessary. 2. **Battery Energy Storage Management**: Managing and scheduling the BESS. 3. **Reactive Power Injection**: Regulating reactive power to maintain system stability. 4. **Load Shedding**: Reducing load in emergency situations. 5. **Transmission System Flexibility Services**: Providing flexibility services to the transmission system. ### Method Characteristics - **State Definition**: States include the PV forecast relative error for each DERS and the storage level for each BESS. - **Action Definition**: Actions include PV generation curtailment, reactive power injection, battery charging/discharging, and load shedding. - **Transition Probability**: Transition probabilities between PV states are calculated based on historical data. - **Cost Calculation**: Various cost types are considered, including penalty costs for PV generation curtailment, penalty costs for load shedding, power loss costs for the grid and DERS, and rewards for providing flexibility services to the transmission system. ### Experimental Results The method was tested on the IEEE 33-bus system, considering various contingencies such as temporary PV generation shutdown, significantly lower than forecasted PV generation, unpredicted load increases, and unplanned flexibility service demands. The experimental results show that the method can achieve lower total costs, especially when there is a significant discrepancy between PV forecasts and actual values. ### Conclusion The MDP-based decision-making method proposed in this paper can effectively minimize the total operational cost of the distribution system, particularly when there is a significant discrepancy between PV forecasts and actual values. This method can serve not only as a decision-making tool but also as an analytical tool to help Distribution System Operators (DSO) determine the optimal location and parameters for DERS. Future work will explore ways to reduce computational complexity to apply this method in more complex systems.

An MDP-Based Approach for Distribution System Control with PV Generation and Battery Storage

MDP-Based Distribution Network Reconfiguration with Renewable Distributed Generation: Approximate Dynamic Programming Approach

Markov Decision Process-based Resilience Enhancement for Distribution Systems: an Approximate Dynamic Programming Approach

Distributed MPC-Based Voltage Control for Active Distribution Networks Considering Uncertainty of Distributed Energy Resources

Editorial: Advanced Technologies for Modeling, Optimization and Control of the Future Distribution Grid

Distributed Model Predictive Control for Energy Systems in Microgrids

Optimal Energy Dispatch of Distributed PVs for the Next Generation of Distribution Management Systems

Distributed Voltage Optimization Control of BESS in AC Distribution Networks with High PV Penetration

A Novel Probabilistic Framework to Study the Impact of PV-battery Systems on Low-Voltage Distribution Networks

A Mathematical Programming Approach for the Optimal Operation of Storage Systems, Photovoltaic and Wind Power Generation

Real-time energy management of photovoltaic-assisted electric vehicle charging station by markov decision process

Battery energy storage system for grid-connected photovoltaic farm – Energy management strategy and sizing optimization algorithm

Proactive Scheduling of Mixed Energy Resources at Different Grid Levels

Battery Dispatching for End Users With On-Site Renewables and Peak Demand Charges--An Approximate Dynamic Programming Approach

Optimal Scheduling Strategy for Distribution Network with Mobile Energy Storage System and Offline Control PVs to Minimize the Solar Energy Curtailment

MPC Based Coordinated Control Method for Distributed Energy Storage in Distribution Network with Balanced Economy and Robustness

MPC-Based Decentralized Voltage Control in Power Distribution Systems with EV and PV Coordination

Long-term optimal planning of distributed generations and battery energy storage systems towards high integration of green energy considering uncertainty and demand response program

Optimal Operation and Management for Smart Grid Subsumed High Penetration of Renewable Energy, Electric Vehicle, and Battery Energy Storage System

Cooperative Dispatch of Distributed Energy Storage in Distribution Network With PV Generation Systems

Robust economic–environmental dispatch problem for BESS and PV generators in MT-HVDC systems: A MI-MPC approach