Abstract:With the growth in energy consumption, demand response (DR) programs in the power network have gained popularity and can be expected to become more widespread in the future. Through DR programs, users are encouraged for utilizing renewable energy and reducing their power consumption at peak times, thereby helping to balance supply and demand on the grid, as well as generating revenue from the sale of excess power. This paper presents an effective energy management layout (EML) for household DR employing Reinforcement Learning (RL) and Fuzzy Reasoning (FR). RL would be a model-free control method that consists of doing measures and assessing the outcomes as it interacts with the environments. Through direct integration of customer feedback into its control logic, the suggested method takes into account user satisfaction by utilizing FR as a reward function. Through the shift of controllable devices from peak hours, whenever energy cost is higher, to off-peak periods, whenever energy cost is low, Q-learning, an RL method according to a reward scheme, has been applied for scheduling the execution of smart home devices. With the suggested method, 14 home devices can be controlled by one agent, and many status-action pairs as well as fuzzy logic for the reward function are used to assess the actions taken for a particular status. Simulations are implemented in the digital twin environment and demonstrate that the suggested device planning method smooths the energy usage and minimizes the energy price by taking into account the consumers' satisfaction, the consumers' feedback, and their satisfaction settings. The Home EML has been presented with a consumer interface in MATLAB/Simulink for demonstrating the suggested DR approach. The simulation tools include smart devices, energy price signals, smart meters, solar photovoltaics, batteries, electric vehicle, and grid supply.

Demand response optimization strategy of electric water heater based on RL

Research on Cost Optimization of Integrated Energy System Based on Power Demand Response

Decentralized Control of Aggregated Loads for Demand Response

A Game-Theoretic Approach to Decentralized Control of Heterogeneous Load Population

Data-Driven Modelling and Optimal Control of Domestic Electric Water Heaters for Demand Response

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

An effective energy management Layout-Based reinforcement learning for household demand response in digital twin simulation

Reinforcement learning of room temperature set-point of thermal storage air-conditioning system with demand response

Price-Based Residential Demand Response Management in Smart Grids: A Reinforcement Learning-Based Approach

Demand response of residential air conditioning load based on user behavior

Reinforcement learning-based demand response strategy for thermal energy storage air-conditioning system considering room temperature and humidity setpoints

A centralized demand response control strategy for domestic electric water heater group based on appliance cloud platform

Using Reinforcement Learning for Demand Response of Domestic Hot Water Buffers: a Real-Life Demonstration

A data-driven DRL-based home energy management system optimization framework considering uncertain household parameters

Deep Reinforcement Learning for Autonomous Water Heater Control

Optimal Control of Intelligent Electricity Consumption for Residential Customers Considering Demand Response

Optimized scheduling of electric water heaters under consideration of water-using time elasticity

Trajectory tracking with an aggregation of domestic hot water heaters: Combining model-based and model-free control in a commercial deployment

Generalized Modeling of Self-scheduling Demand Resource in Multi-Energy System

Deep Reinforcement Learning based Optimal Control of Hot Water Systems

User Preference-Based Demand Response for Smart Home Energy Management Using Multiobjective Reinforcement Learning