Abstract:Driven by the recent advances and applications of smart-grid technologies, our electric power grid is undergoing radical modernization. Microgrid (MG) plays an important role in the course of modernization by providing a flexible way to integrate distributed renewable energy resources (RES) into the power grid. However, distributed RES, such as solar and wind, can be highly intermittent and stochastic. These uncertain resources combined with load demand result in random variations in both the supply and the demand sides, which make it difficult to effectively operate a MG. Focusing on this problem, this paper proposed a novel energy management approach for real-time scheduling of an MG considering the uncertainty of the load demand, renewable energy, and electricity price. Unlike the conventional model-based approaches requiring a predictor to estimate the uncertainty, the proposed solution is learning-based and does not require an explicit model of the uncertainty. Specifically, the MG energy management is modeled as a Markov Decision Process (MDP) with an objective of minimizing the daily operating cost. A deep reinforcement learning (DRL) approach is developed to solve the MDP. In the DRL approach, a deep feedforward neural network is designed to approximate the optimal action-value function, and the deep Q-network (DQN) algorithm is used to train the neural network. The proposed approach takes the state of the MG as inputs, and outputs directly the real-time generation schedules. Finally, using real power-grid data from the California Independent System Operator (CAISO), case studies are carried out to demonstrate the effectiveness of the proposed approach.

AI-Powered Microgrid Networks: Multi-Agent Deep Reinforcement Learning for Optimized Energy Trading in Interconnected Systems

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning

A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids

Peer-to-Peer Energy Trading and Energy Conversion in Interconnected Multi-Energy Microgrids Using Multi-Agent Deep Reinforcement Learning

Deep Reinforcement Learning and Blockchain for Peer-to-Peer Energy Trading among Microgrids

Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning

Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

Peer-to-peer energy trading with energy trading consistency in interconnected multi-energy microgrids: A multi-agent deep reinforcement learning approach

Microgrid energy management using deep Q-network reinforcement learning

A Reliable Energy Trading Strategy in Intelligent Microgrids Using Deep Reinforcement Learning

Multi-agent deep reinforcement learning-based optimal energy management for grid-connected multiple energy carrier microgrids

2A Reliable Energy Trading Strategy in Intelligent Microgrids Using Deep Reinforcement Learning

Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning

Energy Pricing in P2P Energy Systems Using Reinforcement Learning

Microgrid Optimization Strategy for Charging and Swapping Power Stations with New Energy Based on Multi-Agent Reinforcement Learning

Reinforcement Learning-Based Microgrid Energy Trading with a Reduced Power Plant Schedule

Multi-Micro Grid System Reinforcement Across Deregulated Markets, Energy Resources Scheduling and Demand Side Management Using a Multi-Agent-Based Optimization in Smart Grid Paradigm

An Effective Distributed Approach Based Machine Learning for Energy Negotiation in Networked Microgrids