Optimization strategy based on deep reinforcement learning for home energy management

Yuankun Liu,Dongxia Zhang,Hoay Beng Gooi

DOI: https://doi.org/10.17775/cseejpes.2019.02890

IF: 6.014

2020-01-01

CSEE Journal of Power and Energy Systems

Abstract:With the development of a smart grid and smart home, massive amounts of data can be made available, providing the basis for algorithm training in artificial intelligence applications. These continuous improving conditions are expected to enable the home energy management system (HEMS) to cope with the increasing complexities and uncertainties in the enduser side of the power grid system. In this paper, a home energy management optimization strategy is proposed based on deep Q-learning (DQN) and double deep Q-learning (DDQN) to perform scheduling of home energy appliances. The applied algorithms are model-free and can help the customers reduce electricity consumption by taking a series of actions in response to a dynamic environment. In the test, the DDQN is more appropriate for minimizing the cost in a HEMS compared to DQN. In the process of method implementation, the generalization and reward setting of the algorithms are discussed and analyzed in detail. The results of this method are compared with those of Particle Swarm Optimization (PSO) to validate the performance of the proposed algorithm. The effectiveness of applied data-driven methods is validated by using a real-world database combined with the household energy storage model.

energy & fuels,engineering, electrical & electronic

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to improve the efficiency of the Home Energy Management System (HEMS) through optimization strategies in the context of the development of smart homes and smart grids, in order to cope with the increasing complexity and uncertainty on the end - user side of the power system. Specifically, the paper proposes a home energy management optimization strategy based on Deep Q - Learning (DQN) and Double Deep Q - Learning (DDQN) for scheduling home energy devices. These model - free algorithms can take a series of actions according to the dynamic environment to help users reduce power consumption. The paper also discusses the generalization ability of the algorithms and the reward settings, and verifies the effectiveness of the proposed algorithms by comparing the results with the Particle Swarm Optimization (PSO) method. The research results show that DDQN is more effective than DQN in cost minimization and is applicable to different scenarios, such as the situation without photovoltaic (PV) or electric vehicles (EV). In addition, the paper emphasizes the importance of adjusting the reward settings according to the actual situation.

Optimization strategy based on deep reinforcement learning for home energy management

Home Energy Management System Optimization Strategy Based on Reinforcement Learning

A data-driven DRL-based home energy management system optimization framework considering uncertain household parameters

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Deep reinforcement learning based home energy management system with devices operational dependencies

A Novel Forecasting Based Scheduling Method for Household Energy Management System Based on Deep Reinforcement Learning

An Online Home Energy Management System Using Q-Learning and Deep Q-Learning

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Reinforcement Learning-Based Energy Management of Smart Home with Rooftop Solar Photovoltaic System, Energy Storage System, and Home Appliances

Real-Time Energy Management in Smart Homes Through Deep Reinforcement Learning

A Home Energy Management Approach Using Decoupling Value and Policy in Reinforcement Learning

Deep Reinforcement Learning for Smart Home Energy Management

A Hybrid Approach for Home Energy Management with Imitation Learning and Online Optimization

Real-time energy scheduling for home energy management systems with an energy storage system and electric vehicle based on a supervised-learning-based strategy

DRL-HEMS: Deep Reinforcement Learning Agent for Demand Response in Home Energy Management Systems Considering Customers and Operators Perspectives

Interior-point policy optimization based multi-agent deep reinforcement learning method for secure home energy management under various uncertainties

Double Deep Q-learning Based Real-Time Optimization Strategy for Microgrids

A Novel Two-stage Reinforcement Learning Framework for Sustainable Building Energy Management Systems

Comparative Analysis of Reinforcement Learning Approaches for Multi-Objective Optimization in Residential Hybrid Energy Systems

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

A Two-Stage Distributed Optimization Method for Home Energy Management Systems Via Multi-Modal Data-Driven Algorithm