Abstract:With the growth in energy consumption, demand response (DR) programs in the power network have gained popularity and can be expected to become more widespread in the future. Through DR programs, users are encouraged for utilizing renewable energy and reducing their power consumption at peak times, thereby helping to balance supply and demand on the grid, as well as generating revenue from the sale of excess power. This paper presents an effective energy management layout (EML) for household DR employing Reinforcement Learning (RL) and Fuzzy Reasoning (FR). RL would be a model-free control method that consists of doing measures and assessing the outcomes as it interacts with the environments. Through direct integration of customer feedback into its control logic, the suggested method takes into account user satisfaction by utilizing FR as a reward function. Through the shift of controllable devices from peak hours, whenever energy cost is higher, to off-peak periods, whenever energy cost is low, Q-learning, an RL method according to a reward scheme, has been applied for scheduling the execution of smart home devices. With the suggested method, 14 home devices can be controlled by one agent, and many status-action pairs as well as fuzzy logic for the reward function are used to assess the actions taken for a particular status. Simulations are implemented in the digital twin environment and demonstrate that the suggested device planning method smooths the energy usage and minimizes the energy price by taking into account the consumers' satisfaction, the consumers' feedback, and their satisfaction settings. The Home EML has been presented with a consumer interface in MATLAB/Simulink for demonstrating the suggested DR approach. The simulation tools include smart devices, energy price signals, smart meters, solar photovoltaics, batteries, electric vehicle, and grid supply.

Deep reinforcement learning based home energy management system with devices operational dependencies

Autonomous Household Energy Management Using Deep Reinforcement Learning

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Deep Reinforcement Learning for Smart Home Energy Management

Real-Time Energy Management in Smart Homes Through Deep Reinforcement Learning

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Review of Home Energy Management Systems Based on Deep Reinforcement Learning

Home Energy Management System Optimization Strategy Based on Reinforcement Learning

A Human-Machine Reinforcement Learning Method for Cooperative Energy Management.

Optimization strategy based on deep reinforcement learning for home energy management

A Home Energy Management Approach Using Decoupling Value and Policy in Reinforcement Learning

An effective energy management Layout-Based reinforcement learning for household demand response in digital twin simulation

A data-driven DRL-based home energy management system optimization framework considering uncertain household parameters

DRL-HEMS: Deep Reinforcement Learning Agent for Demand Response in Home Energy Management Systems Considering Customers and Operators Perspectives

A Hierarchical Deep Reinforcement Learning-Based Community Energy Trading Scheme for a Neighborhood of Smart Households

An Online Home Energy Management System Using Q-Learning and Deep Q-Learning

Coordinated energy management for integrated energy system incorporating multiple flexibility measures of supply and demand sides: A deep reinforcement learning approach

Reinforcement Learning-Based Energy Management of Smart Home with Rooftop Solar Photovoltaic System, Energy Storage System, and Home Appliances

A Multi-Agent Deep Constrained Q-Learning Method for Smart Building Energy Management Under Uncertainties

Interior-point policy optimization based multi-agent deep reinforcement learning method for secure home energy management under various uncertainties

Reinforcement learning layout‐based optimal energy management in smart home: AI‐based approach