Abstract:Despite significant advancements in out-of-distribution (OOD) detection, existing methods still struggle to maintain robustness against adversarial attacks, compromising their reliability in critical real-world applications. Previous studies have attempted to address this challenge by exposing detectors to auxiliary OOD datasets alongside adversarial training. However, the increased data complexity inherent in adversarial training, and the myriad of ways that OOD samples can arise during testing, often prevent these approaches from establishing robust decision boundaries. To address these limitations, we propose AROS, a novel approach leveraging neural ordinary differential equations (NODEs) with Lyapunov stability theorem in order to obtain robust embeddings for OOD detection. By incorporating a tailored loss function, we apply Lyapunov stability theory to ensure that both in-distribution (ID) and OOD data converge to stable equilibrium points within the dynamical system. This approach encourages any perturbed input to return to its stable equilibrium, thereby enhancing the model's robustness against adversarial perturbations. To not use additional data, we generate fake OOD embeddings by sampling from low-likelihood regions of the ID data feature space, approximating the boundaries where OOD data are likely to reside. To then further enhance robustness, we propose the use of an orthogonal binary layer following the stable feature space, which maximizes the separation between the equilibrium points of ID and OOD samples. We validate our method through extensive experiments across several benchmarks, demonstrating superior performance, particularly under adversarial attacks. Notably, our approach improves robust detection performance from 37.8% to 80.1% on CIFAR-10 vs. CIFAR-100 and from 29.0% to 67.0% on CIFAR-100 vs. CIFAR-10.

Robust One-Class Classification with Signed Distance Function using 1-Lipschitz Neural Networks

Robust-by-Design Classification via Unitary-Gradient Neural Networks

Certified Robustness against Sparse Adversarial Perturbations via Data Localization

Asymmetric Certified Robustness via Feature-Convex Neural Networks

Robust Angular Local Descriptor Learning

Robust optimization for adversarial learning with finite sample complexity guarantees

Robust Randomized Autoencoder and Correntropy Criterion-Based One-Class Classification

Hierarchical One-Class Model With Subnetwork for Representation Learning and Outlier Detection

Maximum Correntropy Criterion-Based Hierarchical One-Class Classification

Certified Adversarial Robustness Under the Bounded Support Set.

Adversarially Robust Out-of-Distribution Detection Using Lyapunov-Stabilized Embeddings

DROCC: Deep Robust One-Class Classification

Local Competition and Uncertainty for Adversarial Robustness in Deep Learning

Robust least squares one-class support vector machine

LBL: Logarithmic Barrier Loss Function for One-class Classification

A Unified Algebraic Perspective on Lipschitz Neural Networks

Towards Certifying L Robustness Using Neural Networks with L-Dist Neurons

Margin-bounded Confidence Scores for Out-of-Distribution Detection

Certified Robustness via Dynamic Margin Maximization and Improved Lipschitz Regularization

Distributionally Robust Multiclass Classification and Applications in Deep Image Classifiers

Regularized Training and Tight Certification for Randomized Smoothed Classifier with Provable Robustness