Abstract:The development of distributed renewable energy resources and smart energy management are efficient approaches to decarbonizing building energy systems. Reinforcement learning (RL) is a data-driven control algorithm that trains a large amount of data to learn control policy. However, this learning process generally presents low learning efficiency using real-world stochastic data. To address this challenge, this study proposes a model-based RL approach to optimize the operation of existing zero-energy houses considering PV generation consumption and energy costs. The model-based approach takes advantage of the inner understanding of the system dynamics; this knowledge improves the learning efficiency. A reward function is designed considering the physical constraints of battery storage, photovoltaic (PV) production feed-in profit, and energy cost. Measured data of a zero-energy house are used to train and test the proposed RL agent control, including Q-learning, deep Q network (DQN), and deep deterministic policy gradient (DDPG) agents. The results show that the proposed RL agents can achieve fast convergence during the training process. In comparison with the rule-based strategy, test cases verify the cost-effectiveness performances of proposed RL approaches in scheduling operations of the hybrid energy system under different scenarios. The comparative analysis of test periods shows that the DQN agent presents better energy cost-saving performances than Q-learning while the Q-learning agent presents more flexible action control of the battery with the fluctuation of real-time electricity prices. The DDPG algorithm can achieve the highest PV self-consumption ratio, 49.4%, and the self-sufficiency ratio reaches 36.7%. The DDPG algorithm outperforms rule-based operation by 7.2% for energy cost during test periods.

Multi-Agent Reinforcement Learning Based Scheduling for Distributed PV-ESS Considering Incomplete Data Acquisition

Exploration-enhanced multi-agent reinforcement learning for distributed PV-ESS scheduling with incomplete data

Hybrid Multi-Agent Reinforcement Learning for Electric Vehicle Resilience Control Towards a Low-Carbon Transition

Research on Multi-objective Optimal Scheduling Strategy of Renewable Energy Distribution Networks

Multi-agent Deep Reinforcement Learning for Resilience-Driven Routing and Scheduling of Mobile Energy Storage Systems

Optimal cooperative scheduling strategy of energy storage and electric vehicle based on residential building integrated photovoltaic

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

Real-Time Multi-Home Energy Management with EV Charging Scheduling Using Multi-Agent Deep Reinforcement Learning Optimization

A Multi-Agent Deep-Reinforcement-Learning-Based Strategy for Safe Distributed Energy Resource Scheduling in Energy Hubs

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Multi-agent DRL-based Data-Driven Approach for PEVs Charging/discharging Scheduling in Smart Grid.

Deep-Reinforcement-Learning-Based Capacity Scheduling for PV-Battery Storage System

Multi-agent optimal scheduling for integrated energy system considering the global carbon emission constraint

Online Scheduling of PV and Energy Storage System Based on Deep Reinforcement Learning

Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm

Performance Assessment and Comparative Analysis of Photovoltaic-Battery System Scheduling in an Existing Zero-Energy House Based on Reinforcement Learning Control

Two-timescale autonomous energy management strategy based on multi-agent deep reinforcement learning approach for residential multicarrier energy system

Multi-agent Based Stochastic Programming for Planning of Fast Charging Station Integrated with Photovoltaic and Energy Storage System

Reinforcement learning-based scheduling strategy for energy storage in microgrid

Multi-agent system consistency-based cooperative scheduling strategy of regional integrated energy system

Research on Data-Driven Optimal Scheduling of Power System