Abstract:Forecasting accuracy in highly uncertain environments is challenging due to the stochastic nature of systems. Deterministic forecasting provides only point estimates and cannot capture potential outcomes. Therefore, probabilistic forecasting has gained significant attention due to its ability to quantify uncertainty, where one of the approaches is to express it as a prediction interval (PI), that explicitly shows upper and lower bounds of predictions associated with a confidence level. High-quality PI is characterized by a high PI coverage probability (PICP) and a narrow PI width. In many real-world applications, the PI width is generally used in risk management to prepare resources that improve reliability and effectively manage uncertainty. A wider PI width results in higher costs for backup resources as decision-making processes often focus on the worst-case scenarios arising with large PI widths under extreme conditions. This study aims to reduce the large PI width from the PI estimation method by proposing a new PI loss function that penalizes the average of the large PI widths more heavily. The proposed formulation is compatible with gradient-based algorithms, the standard approach to training neural networks (NNs), and integrating state-of-the-art NNs and existing deep learning techniques. Experiments with the synthetic dataset reveal that our formulation significantly reduces the large PI width while effectively maintaining the PICP to achieve the desired probability. The practical implementation of our proposed loss function is demonstrated in solar irradiance forecasting, highlighting its effectiveness in minimizing the large PI width in data with high uncertainty and showcasing its compatibility with more complex neural network models. Therefore, reducing large PI widths from our method can lead to significant cost savings by over-allocation of reserve resources.

Constructing prediction intervals to explore uncertainty based on deep neural networks.

Constructing Prediction Intervals to Explore Uncertainty Based on Deep Neural Networks

Coverage-driven Deep Prediction Intervals Method

Exploring Uncertainty in Deep Learning for Construction of Prediction Intervals

Particle Swarm Optimization for Construction of Neural Network-Based Prediction Intervals

An All-Batch Loss for Constructing Prediction Intervals

Construction of Prediction Intervals for Carbon Residual of Crude Oil Based on Deep Stochastic Configuration Networks

Exploring Uncertainty in Regression Neural Networks for Construction of Prediction Intervals

Cost-Oriented Prediction Intervals: on Bridging the Gap Between Forecasting and Decision

Construction of neural network-based prediction intervals for short-term electrical load forecasting

Lower Upper Bound Estimation Method Considering Symmetry for Construction of Prediction Intervals in Flood Forecasting

Uncertainty Handling Using Neural Network-Based Prediction Intervals for Electrical Load Forecasting

An Enriched Prediction Intervals Construction Method with Hybrid Intelligent Optimization

Multi-objective prediction intervals for wind power forecast based on deep neural networks

Efficient estimation of flood forecast prediction intervals via single- and multi-objective versions of the LUBE method

Industrial Prediction Intervals With Data Uncertainty

A Construction Approach to Prediction Intervals Based on Bootstrap and Deep Belief Network.

Large width penalization for neural network-based prediction interval estimation

Interval Construction And Optimization For Mechanical Property Forecasting With Improved Neural Networks

Uncertainty Quantification and Interval Prediction of Equipment Remaining Useful Life Based on Semisupervised Learning

Construction of Prediction Intervals Using Adaptive Neurofuzzy Inference Systems.