Abstract:Understanding and predicting the electricity demand responses to prices are critical activities for system operators, retailers, and regulators. While conventional machine learning and time series analyses have been adequate for the routine demand patterns that have adapted only slowly over many years, the emergence of active consumers with flexible assets such as solar-plus-storage systems, and electric vehicles, introduces new challenges. These active consumers exhibit more complex consumption patterns, the drivers of which are often unobservable to the retailers and system operators. In practice, system operators and retailers can only monitor the net demand (metered at grid connection points), which reflects the overall energy consumption or production exchanged with the grid. As a result, all "behind-the-meter" activities-such as the use of flexibility-remain hidden from these entities. Such behind-the-meter behavior may be controlled by third party agents or incentivized by tariffs; in either case, the retailer's revenue and the system loads would be impacted by these activities behind the meter, but their details can only be inferred. We define the main components of net demand, as baseload, flexible, and self-generation, each having nonlinear responses to market price signals. As flexible demand response and self generation are increasing, this raises a pressing question of whether existing methods still perform well and, if not, whether there is an alternative way to understand and project the unobserved components of behavior. In response to this practical challenge, we evaluate the potential of a data-driven inverse optimization (IO) methodology. This approach characterizes decomposed consumption patterns without requiring direct observation of behind-the-meter behavior or device-level metering [...]

Data-Driven Inverse Optimization for Modeling Intertemporally Responsive Loads

Estimating the Unobservable Components of Electricity Demand Response with Inverse Optimization

Short-term Forecasting of Price-responsive Loads Using Inverse Optimization

Multi-Objective Optimal Dispatch Of Power Systems Integrated With Intermittent Renewable Energy Considering Demand Response

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Integrated Energy System Optimal Operation Using Data-Driven District Heating Network Model

Price-Based Residential Demand Response Management in Smart Grids: A Reinforcement Learning-Based Approach

Data-Driven Optimization Framework for Voltage Regulation in Distribution Systems

A Multi-Layer Interactive Peak-Shaving Model Considering Demand Response Sensitivity

Learning and Optimization for Price-based Demand Response of Electric Vehicle Charging

Data-Driven Real-Time Pricing Strategy and Coordinated Optimization of Economic Load Dispatch in Electricity Market

Offline DRL for Price-Based Demand Response: Learning From Suboptimal Data and Beyond

Distributed Data-Driven Optimization for Voltage Regulation in DistriBution Systems

An Energy Management Optimization Method for Community Integrated Energy System Based on User Dominated Demand Side Response

Optimal Demand Response Incorporating Distribution LMP With PV Generation Uncertainty

A novel short-term multi-energy load forecasting method for integrated energy system based on two-layer joint modal decomposition and dynamic optimal ensemble learning

Instantaneous Electricity Peak Load Forecasting Using Optimization and Machine Learning

Dynamic Optimization of on‐Grid Integrated Energy System Considering Peak‐Shaving Demand Via Learning Methods

Multi‐objective Electrical Demand Response Policy Generation Considering Customer Response Behaviour Learning: an Enhanced Inverse Reinforcement Learning Approach

A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer

Optimization strategy of price‐based demand response considering the bidirectional feedback effect