Abstract:With the application of renewable energy in single office buildings, an increasing number of power grids require building systems coupled with renewable energy to realize off-grid operation. However, the uncertainty of renewable energy sources and the safety of the corresponding energy storage equipment have become major challenges for these systems. Reinforcement learning has made considerable progress in the field of building control as an advanced control algorithm; however, research on its application to the off-grid operation of renewable energy systems, particularly the specific reward function design is limited. Therefore, this study considered the off-grid operation of a renewable building energy system and the safety (prevention of deterioration) of its battery as optimization goals. This study is based on a real building energy system, through the operation control of generators, solar photovoltaics, and batteries to achieve optimization purposes. Aiming at these two optimization goals, this study introduces a detailed reward function design and complete reinforcement learning workflow through a Gaussian distribution. Two deep reinforcement learning (DRL) algorithms were trained and verified by offline reinforcement learning based on the measured data-sets of actual existing buildings in Japan. The results show that the proposed reinforcement learning design can better achieve the two optimization goals of off-grid operation and battery safety under ordinary and extreme conditions. On off-grid operation tasks, the best DRL algorithm can achieve a mean hourly grid power purchase error of less than 2 kWh for the entire optimization window. Furthermore, the proposed deep reinforcement learning algorithms can simultaneously maintain a maximum average 7.72 h of battery unsafe state over the entire 168-hour optimization window.

Optimizing a domestic battery and solar photovoltaic system with deep reinforcement learning

Operational Optimization for Off-Grid Renewable Building Energy System Using Deep Reinforcement Learning

Application-oriented assessment of grid-connected PV-battery system with deep reinforcement learning in buildings considering electricity price dynamics

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Performance Assessment and Comparative Analysis of Photovoltaic-Battery System Scheduling in an Existing Zero-Energy House Based on Reinforcement Learning Control

Solar Power driven EV Charging Optimization with Deep Reinforcement Learning

Adaptive BESS and Grid Setpoints Optimization: A Model-Free Framework for Efficient Battery Management under Dynamic Tariff Pricing

Deep Reinforcement Learning Based Security-Constrained Battery Scheduling in Home Energy System

Learning a local trading strategy: deep reinforcement learning for grid-scale renewable energy integration

Deep Reinforcement Learning for Community Battery Scheduling under Uncertainties of Load, PV Generation, and Energy Prices

Optimization strategy based on deep reinforcement learning for home energy management

Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning

Energy management of a microgrid considering nonlinear losses in batteries through Deep Reinforcement Learning

Home Energy Management System Optimization Strategy Based on Reinforcement Learning

Comparative Analysis of Reinforcement Learning Approaches for Multi-Objective Optimization in Residential Hybrid Energy Systems

Deep dyna reinforcement learning based energy management system for solar operated hybrid electric vehicle using load scheduling technique

Adaptive Optimization Design of Building Energy System for Smart Elderly Care Community Based on Deep Deterministic Policy Gradient

Reinforcement Learning Driven Self-Optimizing Operation for Distributed Battery Electrical Storage System

Autonomous Household Energy Management Using Deep Reinforcement Learning

Electric Vehicle Charging/Discharging Control Method Based on Deep Reinforcement Learning for Photovoltaic Energy Storage Stations

A Hybrid Approach for Home Energy Management with Imitation Learning and Online Optimization