Abstract:We study a class of prediction problems in which relatively few observations have associated responses, but all observations include both standard covariates as well as additional "helper" covariates. While the end goal is to make high-quality predictions using only the standard covariates, helper covariates can be exploited during training to improve prediction. Helper covariates arise in many applications, including forecasting in time series; incorporation of biased or mis-calibrated predictions from foundation models; and sharing information in transfer learning. We propose "prediction aided by surrogate training" ($\texttt{PAST}$), a class of methods that exploit labeled data to construct a response estimator based on both the standard and helper covariates; and then use the full dataset with pseudo-responses to train a predictor based only on standard covariates. We establish guarantees on the prediction error of this procedure, with the response estimator allowed to be constructed in an arbitrary way, and the final predictor fit by empirical risk minimization over an arbitrary function class. These upper bounds involve the risk associated with the oracle data set (all responses available), plus an overhead that measures the accuracy of the pseudo-responses. This theory characterizes both regimes in which $\texttt{PAST}$ accuracy is comparable to the oracle accuracy, as well as more challenging regimes where it behaves poorly. We demonstrate its empirical performance across a range of applications, including forecasting of societal ills over time with future covariates as helpers; prediction of cardiovascular risk after heart attacks with prescription data as helpers; and diagnosing pneumonia from chest X-rays using machine-generated predictions as helpers.

Prediction in the Presence of Response-Dependent Missing Labels

A Novel Approach for Displacement Interval Forecasting of Landslides with Step-Like Displacement Pattern

A Data‐driven Intelligent Model for Landslide Displacement Prediction

Valid model-free spatial prediction

Labels Are Not Perfect: Inferring Spatial Uncertainty in Object Detection

A novel data-driven hybrid intelligent prediction model for reservoir landslide displacement

Onboard Out-of-Calibration Detection of Deep Learning Models using Conformal Prediction

Prediction under Latent Subgroup Shifts with High-Dimensional Observations

Uncertainty-aware Traffic Prediction under Missing Data

Towards Efficient Disaster Response via Cost-effective Unbiased Class Rate Estimation through Neyman Allocation Stratified Sampling Active Learning

Predicting missing values in spatio-temporal satellite data

Sample-Efficient Safety Assurances using Conformal Prediction

Landslide Susceptibility Prediction Based on Positive Unlabeled Learning Coupled With Adaptive Sampling

Poster Abstract: A Dynamic Data-Driven Prediction Model for Sparse Collaborative Sensing Applications

Prediction Aided by Surrogate Training

Deep probabilistic graphical modeling for robust multivariate time series anomaly detection with missing data

Adaptive Optimization for Prediction with Missing Data

Prediction with Incomplete Data under Agnostic Mask Distribution Shift

An Improved Multi-Source Data-Driven Landslide Prediction Method Based on Spatio-Temporal Knowledge Graph

Real-time hydrogen release and dispersion modelling of hydrogen refuelling station by using deep learning probability approach

Optimize the Coverage Probability of Prediction Interval for Anomaly Detection of Sensor-Based Monitoring Series