Abstract:Cross-sectional prediction is common in many domains such as healthcare, including forecasting tasks using electronic health records, where different patients form a cross-section. We focus on the task of constructing valid prediction intervals (PIs) in time series regression with a cross-section. A prediction interval is considered valid if it covers the true response with (a pre-specified) high probability. We first distinguish between two notions of validity in such a setting: cross-sectional and longitudinal. Cross-sectional validity is concerned with validity across the cross-section of the time series data, while longitudinal validity accounts for the temporal dimension. Coverage guarantees along both these dimensions are ideally desirable; however, we show that distribution-free longitudinal validity is theoretically impossible. Despite this limitation, we propose Conformal Prediction with Temporal Dependence (CPTD), a procedure that is able to maintain strict cross-sectional validity while improving longitudinal coverage. CPTD is post-hoc and light-weight, and can easily be used in conjunction with any prediction model as long as a calibration set is available. We focus on neural networks due to their ability to model complicated data such as diagnosis codes for time series regression, and perform extensive experimental validation to verify the efficacy of our approach. We find that CPTD outperforms baselines on a variety of datasets by improving longitudinal coverage and often providing more efficient (narrower) PIs.

Long-Term Prediction Intervals of Time Series

A Fuzzy-Rough Based Approach For Time-Series Prediction

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

Exploring Long-Memory Process in the Prediction of Interval-Valued Financial Time Series and Its Application

Empirical prediction intervals for additive Holt–Winters methods under misspecification

A General Framework for Prediction in Time Series Models

Estimation of and Inference about the Expected Shortfall for Time Series with Infinite Variance

Conformal Prediction Intervals with Temporal Dependence

Threshold Autoregressive Models for Interval-Valued Time Series Data

Prediction with eventual almost sure guarantees

Sparse Interval-valued Time Series Modeling with Machine Learning

Condition Evaluation for Speculative Systems: a Streaming Time Series Case.

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Simultaneous Confidence Bands for Time-Series Prediction Function

Valid prediction intervals for regression problems

UTOPIA: Universally Trainable Optimal Prediction Intervals Aggregation

An Integrated Reservoir Predictor Based on Spatiotemporal Information Transformation

Adaptive Conformal Predictions for Time Series

Fractional stochastic configuration networks-based nonstationary time series prediction and confidence interval estimation

On the modelling and prediction of high-dimensional functional time series

Prediction in Measurement Error Models