A Real-time Demand Response Strategy of Home Energy Management by Using Distributed Deep Reinforcement Learning.

Weirong Liu,Yujie Wang,Fu Jiang,Yijun Cheng,Jieqi Rong,Chenglong Wang,Jun Peng
DOI: https://doi.org/10.1109/hpcc-dss-smartcity-dependsys53884.2021.00157
2021-01-01
Abstract:Home energy management system (HEMS) autonomously schedules the energy usage of home electricity consuming devices to reduce the electricity cost based on real-time electricity price. However, it is very challenging to design an optimal energy management strategy under the uncertainty of the resident's behavior, outdoor temperature and renewable generation. To solve this problem, a real-time demand response (DR) strategy based on deep reinforcement learning (DRL) is proposed. Firstly, the real-time DR management problem is modeled as a Markov game, and then a home energy management algorithm is proposed based on Multi-Agent Twin Delayed Deep Deterministic Policy Gradient (MATD3). It is worth mentioning that the proposed algorithm builds the thermal dynamics model and takes energy storage system (ESS) into account, which improves the utilization of renewable power generation effectively. The simulation result based on real-world data demonstrates the effectiveness of the proposed algorithm.
What problem does this paper attempt to address?