Abstract:Machine learning (ML) is playing an increasingly important role in scientific research. In conjunction with classical statistical approaches, ML-assisted analytical strategies have shown great promise in accelerating research findings. This has also opened a whole field of methodological research focusing on integrative approaches that leverage both ML and statistics to tackle data science challenges. One type of study that has quickly gained popularity employs ML to predict unobserved outcomes in massive samples, and then uses predicted outcomes in downstream statistical inference. However, existing methods designed to ensure the validity of this type of post-prediction inference are limited to very basic tasks such as linear regression analysis. This is because any extension of these approaches to new, more sophisticated statistical tasks requires task-specific algebraic derivations and software implementations, which ignores the massive library of existing software tools already developed for the same scientific problem given observed data. This severely constrains the scope of application for post-prediction inference. To address this challenge, we introduce a novel statistical framework named PSPS for task-agnostic ML-assisted inference. It provides a post-prediction inference solution that can be easily plugged into almost any established data analysis routines. It delivers valid and efficient inference that is robust to arbitrary choice of ML model, allowing nearly all existing statistical frameworks to be incorporated into the analysis of ML-predicted data. Through extensive experiments, we showcase our method's validity, versatility, and superiority compared to existing approaches. Our software is available at <a class="link-external link-https" href="https://github.com/qlu-lab/psps" rel="external noopener nofollow">this https URL</a>.

Prediction de‐correlated inference: A safe approach for post‐prediction inference

Prediction De-Correlated Inference

Another look at inference after prediction

Revisiting inference after prediction

Federated Prediction-Powered Inference from Decentralized Data

Assumption-Lean and Data-Adaptive Post-Prediction Inference

Local Prediction-Powered Inference

DistPred: A Distribution-Free Probabilistic Inference Method for Regression and Forecasting

Divide-and-Conquer Predictive Coding: a structured Bayesian inference algorithm

DeepOffense: a Recurrent Network Based Approach for Crime Prediction

Bayesian Prediction-Powered Inference

Doubly Distributed Supervised Learning and Inference with High-Dimensional Correlated Outcomes

Adaptive, Distribution-Free Prediction Intervals for Deep Networks

Distributed Computing and Inference for Big Data

Task-Agnostic Machine-Learning-Assisted Inference

Exact and Robust Conformal Inference Methods for Predictive Machine Learning With Dependent Data

The Conditional Prediction Function: A Novel Technique to Control False Discovery Rate for Complex Models

CogDPM: Diffusion Probabilistic Models via Cognitive Predictive Coding

Probabilistic Classifier Chain Inference via Gibbs Sampling.

Invariant Probabilistic Prediction