Abstract:Machine learning often lacks transparent performance indicators, especially in generating point predictions. This paper addresses this limitation through conformal prediction, a non-parametric forecasting technique seamlessly integrating with regression algorithms to produce prediction intervals at specified confidence levels. A crucial element in conformal prediction is the non-conformity score, traditionally based on absolute residual errors. In this work, we propose a novel approach, introducing data-dependent weights for computing non-conformity scores. This enhancement, considering the distances of training instances from the test sample, aims to improve overall algorithm performance. Empirical investigations across various real-world regression data sets, including scientific data, evaluate the efficiency and validity of prediction intervals from different uncertainty quantification methods. Results show that prediction intervals computed with data-dependent weights adapt to estimator uncertainty, offering more precise predictions in certain scenarios and appropriately conservative predictions in high uncertainty situations. Additionally, we compare predictive regions generated by conformal prediction with those from Gaussian Process Regression (GPR) for scientific data in structural engineering. To augment conformal prediction, we explore Conformalized Quantile Regression (CQR), a recent innovation combining conformal prediction with classical quantile regression, claiming full adaptability to heteroscedasticity. Our findings indicate that conformal prediction methods using data-dependent non-conformity scores achieve a 1% higher effective coverage level and a 15% reduction in prediction interval widths compared to other methods. The comparative analysis against GPR and CQR underscores the practical value of our approach in providing accurate prediction intervals in scientific and engineering domains.

Optimized Kernel-Based Conformal Predictor for Online Fault Detection

Statistical Process Monitoring Based on the Kernel Mean Discrepancy Test

Combining Kernel Principal Component Analysis and Spatial Group-Wise Enhance Convolutional Neural Network for Fault Recognition of Rolling Element Bearings

Automatic Determination of Optimal Fault Detection Filter

A novel fault diagnosis system using pattern classification on kernel FDA subspace

Kernel Generalization of Multi-Rate Probabilistic Principal Component Analysis for Fault Detection in Nonlinear Process

New KPCA Based Fault Detection Algorithm Integrating FDA-PCMC Based Sample Classification

A sub-principal component of fault detection (PCFD) modeling method and its application to online fault diagnosis

Fault diagnosis based on imbalance modified kernel Fisher discriminant analysis

Accelerated Kernel Canonical Correlation Analysis with Fault Relevance for Nonlinear Process Fault Isolation

C-Adapter: Adapting Deep Classifiers for Efficient Conformal Prediction Sets

Online Fault Diagnosis in Industrial Processes Using Multimodel Exponential Discriminant Analysis Algorithm

A new transferable bearing fault diagnosis method with adaptive manifold probability distribution under different working conditions

Adaptive Conformal Prediction Intervals Using Data-Dependent Weights With Application to Seismic Response Prediction

Kernel classifier with adaptive structure and fixed memory for process diagnosis

A Data‐driven Fault Detection Approach with Performance Optimization

Constrained Active Fault Tolerant Control Based on Active Fault Diagnosis and Interpolation Optimization

Optimized conformal classification using gradient descent approximation

Predictive Inference With Fast Feature Conformal Prediction

Online Fault Prognostics Based on Degradation-Oriented Slow Feature Analysis and Temporal Smoothness Analysis

Fault Diagnosis of Tennessee Eastman Process Using Signal Geometry Matching Technique