Abstract:Heat supply accounts for a substantial amount of terminal energy usage. However, along with price rises in primary energy, there is an urgent need to reduce the average cost of energy consumption during the purchasing of thermal services. Electric heating, an electricity-fed heating production and delivery technology, has been suggested as a promising method for improving heating efficiency, due to the ease of scheduling. However, the traditional centralized operating methods of electricity purchasing rely on explicit physical modeling of every detail, and accurate future predictions, the implementation of which are rarely practical in reality. To facilitate model-free decisions in the field of electricity purchasing, heat storage, and supply management, aimed at cost saving in a real-time price environment, this study proposes a scheduling framework based on deep reinforcement learning (DRL) and the existence of responsive users. First, the structure of a distributed heating system fed by regenerative electric boilers (REBs), which facilitate shiftable heat-load control, is introduced. A terminal heat demand response model based on thermal sensation vote (TSV), characterizing the consumption flexibility of responsive users, is also proposed. Second, due to thermal system inertia, the sequential decision problem of electric heating load scheduling is transformed into a specific Markov decision process (MDP). Finally, the edge intelligence (EI) deployed on the demand side uses a twin delayed deterministic policy gradient (TD-3) algorithm to address the action space continuity of electric heating devices. The combination of a DRL strategy and the computing power of EI enables real-time optimal scheduling. Unlike the traditional method, the trained intelligent agent makes adaptive control strategies according to the currently observed state space, thus avoiding prediction uncertainty. The simulation results validate that the intelligent agent responds positively to changes in electricity prices and weather conditions, reducing electricity consumption costs while maintaining user comfort. The adaptability and generalization of the proposed approach to different conditions is also demonstrated.

An Intelligent Scheduling Approach for Electric Power Generation

PRACTICAL MODEL AND ALGORITHM OF DAILY GENERATION DISPATCHING SCHEDULE

Annual rolling generation scheduling and unit commitment optimization model based on open and impartial dispatching

Optimal Scheduling Strategy of Wind–Solar–Thermal-Storage Power Energy Based on CGAN and Dynamic Line–Rated Power

An intelligent scheduling control method for smart grid based on deep learning

Reinforcement Learning and Stochastic Optimization with Deep Learning-Based Forecasting on Power Grid Scheduling

Integration Scheme for Economic Load Dispatching and Optimization Control in Coal-Fired Plants Based on Sparse Gaussian Process Model and Deep Reinforcement Learning

Reinforcement Learning Optimized Intelligent Electricity Dispatching System

Power Generation Dispatching for Environmental Protection Based on Recursive Neural Network and Ant Colony Optimization Algorithm

A New Power System Dispatching Optimization Method Based on Reinforcement Learning

An Energy-saving Generation Dispatching Algorithm for Thermal Power Units Based on Equal Comprehensive Coal Consumption Incremental Principle

Energy-saving Generation Dispatch Toward a Sustainable Electric Power Industry in China

Adaptive time division power dispatch based on numerical characteristics of net loads

Edge Intelligence Enabled Optimal Scheduling with Distributed Price-Responsive Load for Regenerative Electric Boilers

Deep Reinforcement Learning-Based Scheduling Optimization of a Wind-solar Coupled CHP Unit System Considering Source-load Uncertainty

The Optimal Dispatching Strategy of Cogeneration Based on Deep Q-Network (DQN) Algorithm

Brain storming optimization algorithm for heating dispatch scheduling of thermal power plant

Smart Grid Dispatching Optimization For System Resilience Improvement

Intra-day Multi-sequential Generation Schedule Considering Energy Storage System

Within-day Rolling Optimal Scheduling Problem for Active Distribution Networks by Multi-Objective Evolutionary Algorithm Based on Decomposition Integrating with Thought of Simulated Annealing

Time-Interval-Varying Optimal Power Dispatch Strategy Based on Net Load Time-Series Characteristics