Abstract:In this work, we extend the data-driven It\^{o} stochastic differential equation (SDE) framework for the pathwise assessment of short-term forecast errors to account for the time-dependent upper bound that naturally constrains the observable historical data and forecast. We propose a new nonlinear and time-inhomogeneous SDE model with a Jacobi-type diffusion term for the phenomenon of interest, simultaneously driven by the forecast and the constraining upper bound. We rigorously demonstrate the existence and uniqueness of a strong solution to the SDE model by imposing a condition for the time-varying mean-reversion parameter appearing in the drift term. The normalized forecast function is thresholded to keep such mean-reversion parameters bounded. The SDE model parameter calibration also covers the thresholding parameter of the normalized forecast by applying a novel iterative two-stage optimization procedure to user-selected approximations of the likelihood function. Another novel contribution is estimating the transition density of the forecast error process, not known analytically in a closed form, through a tailored kernel smoothing technique with the control variate method. We fit the model to the 2019 photovoltaic (PV) solar power daily production and forecast data in Uruguay, computing the daily maximum solar PV production estimation. Two statistical versions of the constrained SDE model are fit, with the beta and truncated normal distributions as proxies for the transition density. Empirical results include simulations of the normalized solar PV power production and pathwise confidence bands generated through an indirect inference method. An objective comparison of optimal parametric points associated with the two selected statistical approximations is provided by applying the innovative kernel density estimation technique of the transition function of the forecast error process.

Harnessing Kernel Regression for Stochastic State Estimation in Solar-Integrated Power Grids

Wind Power System State Estimation with Automatic Differentiation Technique

Stochastic Dynamic Analysis for Power Systems under Uncertain Variability

Evaluating Composite Approaches to Modelling High-Dimensional Stochastic Variables in Power Systems

Distribution System State Estimation in the Presence of High Solar Penetration

Data-Driven Dynamic State Estimation of Photovoltaic Systems via Sparse Regression Unscented Kalman Filter

A Fast and Robust State Estimator Based on Exponential Function for Power Systems

Short-Term Solar Power Forecasting Based on Weighted Gaussian Process Regression.

State Estimation for Future Energy Grids

Nonparametric Stochastic Differential Equations for Ultra-Short-Term Probabilistic Forecasting of Wind Power Generation

Robust Dynamic State Estimation of Multi-Machine Power Networks with Solar Farms and Dynamics Loads

Surrogate Model-Based Multi-timescale Stochastic Control of Islanded Cascaded Hydro-Solar System Considering Non-Gaussian Uncertainty

Probabilistic Forecasting of Photovoltaic Generation: an Efficient Statistical Approach

Physics-Informed Gaussian Process Regression for Probabilistic States Estimation and Forecasting in Power Grids

Short-term Prediction and Filtering of Solar Power Using State-Space Gaussian Processes

Gefcom2014 Probabilistic Solar Power Forecasting Based On K-Nearest Neighbor And Kernel Density Estimator

Short-Term Solar Power Forecasting: A Combined Long Short-Term Memory and Gaussian Process Regression Method

Data-driven uncertainty quantification for constrained stochastic differential equations and application to solar photovoltaic power forecast data

Review of Kernel Learning for Intra-Hour Solar Forecasting with Infrared Sky Images and Cloud Dynamic Feature Extraction

State Estimation for Hybrid AC/DC Power Grids Based on Pseudo Measurement Modelling of Converters

Real-time robust forecasting-aided state estimation of power system based on data-driven models