Abstract:The dynamic evolution of the modern energy landscape has forced the integration of renewable energy sources (RESs) into power generation, catalyzing a paradigm shift towards converter-dominated power systems. This paper addresses the imperative challenge of optimizing power-generating technologies within these complex systems to ensure both stability and sustainability. The underlying issue lies in effectively managing the energy-mix proportion—balancing the total electricity generated with the overall system load—while accounting for the intermittent nature of RESs. Motivated by the insistent need for adaptive and efficient power system management, this paper presents a pioneering deep reinforcement learning (DRL) approach within modern power system applications. Leveraging the Deep Q-Network (DQN) paradigm, the proposed methodology estimates the energy-mix proportion through a data-driven lens. By integrating MATLAB/Simulink and Python libraries, offline training and online testing validate the approach's applicability in real-world scenarios. Results from comprehensive experiments on an IEEE-9 bus system underscore the efficacy of the DRL-based framework. Notably, the online short circuit level (SCL) emerges as a robust indicator of power system security, a significant innovation in stability assessment. The model demonstrates remarkable responsiveness to load fluctuations, optimizing energy generation and respecting operational constraints. Furthermore, the adaptability of grid-forming (GFM) and grid-following (GFL) converters is showcased, highlighting their resilience in converter-dominated power systems. The study offers a promising avenue for future research and underscores the potential of DRL in power system optimization and operation for a sustainable energy future.

Deep Reinforcement Learning–based Approach for Optimizing Energy Conversion in Integrated Electrical and Heating System with Renewable Energy

Economical Operation Strategy of an Integrated Energy System with Wind Power and Power to Gas Technology – a DRL‐based Approach

Dynamic energy conversion and management strategy for an integrated electricity and natural gas system with renewable energy: Deep reinforcement learning approach

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Low-carbon Economic Dispatch of Electricity-Heat-Gas Integrated Energy Systems Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Coordinated energy management for integrated energy system incorporating multiple flexibility measures of supply and demand sides: A deep reinforcement learning approach

Deep reinforcement learning approach to estimate the energy-mix proportion for secure operation of converter-dominated power system

An optimal solutions-guided deep reinforcement learning approach for online energy storage control

Knowledge-network-embedded deep reinforcement learning: An innovative way to high-efficiently develop an energy management strategy for the integrated energy system with renewable energy sources and multiple energy storage systems

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources

A Control Strategy Based on Deep Reinforcement Learning Under the Combined Wind-Solar Storage System

Comparative Analysis of Reinforcement Learning Approaches for Multi-Objective Optimization in Residential Hybrid Energy Systems

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Physical-model-free intelligent energy management for a grid-connected hybrid wind-microturbine-PV-EV energy system via deep reinforcement learning approach

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy