Abstract:In the dynamic realms of machine learning and deep learning, the robustness and reliability of models are paramount, especially in critical real-world applications. A fundamental challenge in this sphere is managing Out-of-Distribution (OOD) samples, significantly increasing the risks of model misclassification and uncertainty. Our work addresses this challenge by enhancing the detection and management of OOD samples in neural networks. We introduce OOD-R (Out-of-Distribution-Rectified), a meticulously curated collection of open-source datasets with enhanced noise reduction properties. In-Distribution (ID) noise in existing OOD datasets can lead to inaccurate evaluation of detection algorithms. Recognizing this, OOD-R incorporates noise filtering technologies to refine the datasets, ensuring a more accurate and reliable evaluation of OOD detection algorithms. This approach not only improves the overall quality of data but also aids in better distinguishing between OOD and ID samples, resulting in up to a 2.5\% improvement in model accuracy and a minimum 3.2\% reduction in false positives. Furthermore, we present ActFun, an innovative method that fine-tunes the model's response to diverse inputs, thereby improving the stability of feature extraction and minimizing specificity issues. ActFun addresses the common problem of model overconfidence in OOD detection by strategically reducing the influence of hidden units, which enhances the model's capability to estimate OOD uncertainty more accurately. Implementing ActFun in the OOD-R dataset has led to significant performance enhancements, including an 18.42\% increase in AUROC of the GradNorm method and a 16.93\% decrease in FPR95 of the Energy method. Overall, our research not only advances the methodologies in OOD detection but also emphasizes the importance of dataset integrity for accurate algorithm evaluation.

FIXC: A Method for Data Distribution Shifts Calibration via Feature Importance

Explanation-based Counterfactual Retraining(XCR): A Calibration Method for Black-box Models

The FIX Benchmark: Extracting Features Interpretable to eXperts

FairFix: Enhancing Fairness of Pre-Trained Deep Neural Networks with Scarce Data Resources

F-Fidelity: A Robust Framework for Faithfulness Evaluation of Explainable AI

Operational Calibration: Debugging Confidence Errors for DNNs in the Field

Calibrating Deep Neural Network using Euclidean Distance

DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization

Adaptive Calibrator Ensemble for Model Calibration under Distribution Shift

DC4L: Distribution Shift Recovery via Data-Driven Control for Deep Learning Models

Boosting Out-of-distribution Detection with Typical Features

DICE: Detecting In-distribution Contamination in LLM's Fine-tuning Phase for Math Reasoning

Stable Learning via Causality-based Feature Rectification

CASE: Exploiting Intra-class Compactness and Inter-class Separability of Feature Embeddings for Out-of-Distribution Detection

Feature Perturbation Augmentation for Reliable Evaluation of Importance Estimators in Neural Networks

GAIA: Delving into Gradient-based Attribution Abnormality for Out-of-distribution Detection

Advancing Out-of-Distribution Detection through Data Purification and Dynamic Activation Function Design

Root Causing Prediction Anomalies Using Explainable AI

Are Data-driven Explanations Robust against Out-of-distribution Data?

Beyond Dropout: Feature Map Distortion to Regularize Deep Neural Networks