Abstract:Modern home energy management systems (HEMSs) have great flexibility of energy consumption for customers, but at the same time, bear a range of problems, such as the high system complexity, uncertainty and time-varying nature of load consumptions, and renewable sources generation. This has brought great challenges for the real-time control. To solve these problems, we propose an HEMS that integrates a kernel-based real-time adaptive dynamic programming (K-RT-ADP) with a new preprocessing short-term prediction technique. For the preprocessing short-term prediction, we propose a gated recurrent unit-bidirectional encoder representations from the transformer (GRU-BERT) model to improve the forecasting accuracy of electrical loads and renewable energy generation. In particular, we classify household appliances into the temperature-sensitive loads, human activity sensitive loads, and insensitive/constant loads. The GRU-BERT model can incorporate weather and human activity information to predict load consumption and solar generation. For real-time control, we propose and employ the K-RT-ADP HEMS based on the GRU-BERT prediction algorithm. The objective of the K-RT-ADP HEMS is to minimize the electricity cost and maximize the solar energy utilization. To enhance the nonlinear approximation ability and generalization ability of the adaptive dynamic programming (ADP) algorithm, the K-RT-ADP algorithm leverages kernel mapping instead of neural networks. Hardware-in-the-loop experiments demonstrate the superiority of the proposed K-RT-ADP HEMS over the traditional ADP control through comparison.

Real-time Energy Management for the Integrated Heat and Power System Using Approximate Dynamic Programming

Real-time Optimization of the Integrated Gas and Power Systems Using Hybrid Approximate Dynamic Programming

Intraday Optimal Dispatch of Integrated Energy System Based on Dynamic Models

Stochastic Energy Management of Active Distribution Network Based on Improved Approximate Dynamic Programming

Fully Distributed Optimization for Combined Heat and Power Dispatch

Optimal Inter- and Intra-Hour Scheduling of Islanded Integrated-Energy System Considering Linepack of Gas Pipelines

Efficient Robust Dispatch of Combined Heat and Power Systems

Integrated Energy System Optimal Operation Using Data-Driven District Heating Network Model

Approximate Dynamic Programming with Enhanced Off-policy Learning for Coordinating Distributed Energy Resources

A Kernel-Based Real-Time Adaptive Dynamic Programming Method for Economic Household Energy Systems

Distributed Operation for Integrated Electricity and Heat System with Hybrid Stochastic/Robust Optimization

RSM-Based Approximate Dynamic Programming for Stochastic Energy Management of Power Systems

Day-ahead scheduling strategy for integrated heating and power system with high wind power penetration and integrated demand response: A hybrid stochastic/interval approach

Stochastic Optimization of Economic Dispatch for Microgrid Based on Approximate Dynamic Programming

Dynamic Energy Management for Hybrid Electric Vehicle Based on Adaptive Dynamic Programming

Decentralized robust energy and reserve Co-optimization for multiple integrated electricity and heating systems

Machine Learning Based State-Space Approximate Dynamic Programming Approach for Energy and Reserve Management of Power Plants

Adaptively optimal energy management for integrated hydrogen energy systems

Optimal scheduling of integrated energy system considering renewable energy uncertainties based on distributionally robust adaptive MPC

Design and HIL Realization of an Online Adaptive Dynamic Programming Approach for Real-Time Economic Operations of Household Energy Systems

Constrained Decoupling Adaptive Dynamic Programming for A Partially Uncontrollable Time-Delayed Model of Energy Systems