Abstract:Machine learning often lacks transparent performance indicators, especially in generating point predictions. This paper addresses this limitation through conformal prediction, a non-parametric forecasting technique seamlessly integrating with regression algorithms to produce prediction intervals at specified confidence levels. A crucial element in conformal prediction is the non-conformity score, traditionally based on absolute residual errors. In this work, we propose a novel approach, introducing data-dependent weights for computing non-conformity scores. This enhancement, considering the distances of training instances from the test sample, aims to improve overall algorithm performance. Empirical investigations across various real-world regression data sets, including scientific data, evaluate the efficiency and validity of prediction intervals from different uncertainty quantification methods. Results show that prediction intervals computed with data-dependent weights adapt to estimator uncertainty, offering more precise predictions in certain scenarios and appropriately conservative predictions in high uncertainty situations. Additionally, we compare predictive regions generated by conformal prediction with those from Gaussian Process Regression (GPR) for scientific data in structural engineering. To augment conformal prediction, we explore Conformalized Quantile Regression (CQR), a recent innovation combining conformal prediction with classical quantile regression, claiming full adaptability to heteroscedasticity. Our findings indicate that conformal prediction methods using data-dependent non-conformity scores achieve a 1% higher effective coverage level and a 15% reduction in prediction interval widths compared to other methods. The comparative analysis against GPR and CQR underscores the practical value of our approach in providing accurate prediction intervals in scientific and engineering domains.

Conformalized Adaptive Forecasting of Heterogeneous Trajectories

Adaptive Model Prediction Control-Based Multi-Terrain Trajectory Tracking Framework for Mobile Spherical Robots

Adaptive Conformal Prediction for Motion Planning among Dynamic Agents

Single Trajectory Conformal Prediction

Efficient Trajectory Forecasting and Generation with Conditional Flow Matching

Multi-model Ensemble Conformal Prediction in Dynamic Environments

Conformal Prediction for Uncertainty-Aware Planning with Diffusion Dynamics Model

Safe Planning in Dynamic Environments using Conformal Prediction

Online Aggregation of Conformal Forecasting Systems

Conformal Prediction for Distribution-free Optimal Control of Linear Stochastic Systems

CUQDS: Conformal Uncertainty Quantification under Distribution Shift for Trajectory Prediction

A Conformal Prediction Approach to Explore Functional Data

Adaptive Conformal Prediction Intervals Using Data-Dependent Weights With Application to Seismic Response Prediction

Conformal PID Control for Time Series Prediction

Streaming Motion Forecasting for Autonomous Driving

Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding

Safety-Critical Control with Uncertainty Quantification using Adaptive Conformal Prediction

Conformal Prediction Regions for Time Series using Linear Complementarity Programming

Copula Conformal Prediction for Multi-step Time Series Forecasting

A general framework for multi-step ahead adaptive conformal heteroscedastic time series forecasting

Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrums