Abstract:With the growth in energy consumption, demand response (DR) programs in the power network have gained popularity and can be expected to become more widespread in the future. Through DR programs, users are encouraged for utilizing renewable energy and reducing their power consumption at peak times, thereby helping to balance supply and demand on the grid, as well as generating revenue from the sale of excess power. This paper presents an effective energy management layout (EML) for household DR employing Reinforcement Learning (RL) and Fuzzy Reasoning (FR). RL would be a model-free control method that consists of doing measures and assessing the outcomes as it interacts with the environments. Through direct integration of customer feedback into its control logic, the suggested method takes into account user satisfaction by utilizing FR as a reward function. Through the shift of controllable devices from peak hours, whenever energy cost is higher, to off-peak periods, whenever energy cost is low, Q-learning, an RL method according to a reward scheme, has been applied for scheduling the execution of smart home devices. With the suggested method, 14 home devices can be controlled by one agent, and many status-action pairs as well as fuzzy logic for the reward function are used to assess the actions taken for a particular status. Simulations are implemented in the digital twin environment and demonstrate that the suggested device planning method smooths the energy usage and minimizes the energy price by taking into account the consumers' satisfaction, the consumers' feedback, and their satisfaction settings. The Home EML has been presented with a consumer interface in MATLAB/Simulink for demonstrating the suggested DR approach. The simulation tools include smart devices, energy price signals, smart meters, solar photovoltaics, batteries, electric vehicle, and grid supply.

Autonomous Household Energy Management Using Deep Reinforcement Learning

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

Deep reinforcement learning based home energy management system with devices operational dependencies

Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework

A Human-Machine Reinforcement Learning Method for Cooperative Energy Management.

An effective energy management Layout-Based reinforcement learning for household demand response in digital twin simulation

DRL-HEMS: Deep Reinforcement Learning Agent for Demand Response in Home Energy Management Systems Considering Customers and Operators Perspectives

A Hierarchical Deep Reinforcement Learning-Based Community Energy Trading Scheme for a Neighborhood of Smart Households

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

A Multi-Agent Deep Constrained Q-Learning Method for Smart Building Energy Management Under Uncertainties

Reward Shaping-Based Actor–Critic Deep Reinforcement Learning for Residential Energy Management

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Reward Mechanism Design for Deep Reinforcement Learning-Based Microgrid Energy Management

On-line Building Energy Optimization using Deep Reinforcement Learning

A Deep Reinforcement Learning-Based Approach for the Residential Appliances Scheduling

Distributed Deep Reinforcement Learning for Intelligent Load Scheduling in Residential Smart Grids

Deep Reinforcement Learning for Smart Home Energy Management

A Federated DRL Approach for Smart Micro-Grid Energy Control with Distributed Energy Resources

Deep Reinforcement Learning-Based Demand Response for Smart Facilities Energy Management

Federated Reinforcement Learning for Energy Management of Multiple Smart Homes With Distributed Energy Resources

A Home Energy Management Approach Using Decoupling Value and Policy in Reinforcement Learning