Abstract:Conformal predictors are an important class of algorithms that allow predictions to be made with a user-defined confidence level. They are able to do this by outputting prediction sets, rather than simple point predictions. The conformal predictor is valid in the sense that the accuracy of its predictions is guaranteed to meet the confidence level, only assuming exchangeability in the data. Since accuracy is guaranteed, the performance of a conformal predictor is measured through the efficiency of the prediction sets. Typically, a conformal predictor is built on an underlying machine learning algorithm and hence its predictive power is inherited from this algorithm. However, since the underlying machine learning algorithm is not trained with the objective of minimizing predictive efficiency it means that the resulting conformal predictor may be sub-optimal and not aligned sufficiently to this objective. Hence, in this study we consider an approach to train the conformal predictor directly with maximum predictive efficiency as the optimization objective, and we focus specifically on the inductive conformal predictor for classification. To do this, the conformal predictor is approximated by a differentiable objective function and gradient descent used to optimize it. The resulting parameter estimates are then passed to a proper inductive conformal predictor to give valid prediction sets. We test the method on several real world data sets and find that the method is promising and in most cases gives improved predictive efficiency against a baseline conformal predictor.

Cross-conformal predictors

Computationally efficient versions of conformal predictive distributions

Conformal e-prediction

Optimized conformal classification using gradient descent approximation

Conformal calibrators

Beyond Conformal Predictors: Adaptive Conformal Inference with Confidence Predictors

Nothing Conformal about Adaptive Conformal Inference

Investigating Data Usage for Inductive Conformal Predictors

Efficient Conformal Prediction via Cascaded Inference with Expanded Admission

Predictive Inference with Feature Conformal Prediction

Posterior Conformal Prediction

Approximation to Object Conditional Validity with Inductive Conformal Predictors

Conformal Prediction Intervals with Temporal Dependence

Geodesic-based Kernelizing K Nearest Neighbor Conformal Predictor

Improving Expert Predictions with Conformal Prediction

Generalization and Informativeness of Conformal Prediction

Multi-Modal Conformal Prediction Regions by Optimizing Convex Shape Templates

Optimized Kernel-Based Conformal Predictor for Online Fault Detection

Self-Calibrating Conformal Prediction

Conformal Prediction via Regression-as-Classification

Localized Conformal Prediction: A Generalized Inference Framework for Conformal Prediction