Abstract:In contemporary machine learning, models often struggle with data distribution variations, severely impacting their out-of-distribution (OOD) generalization and detection capabilities. Current object detection methods, relying on virtual outlier synthesis and class-conditional density estimation, struggle to effectively distinguish OOD samples. They often depend on accurate density estimation and may produce virtual outliers that lack realism, particularly in complex or dynamic environments. Furthermore, previous research has typically addressed covariate and semantic shifts independently, resulting in fragmented solutions that fail to comprehensively tackle OOD generalization. This study introduces a unified approach to enhance OOD generalization in object recognition models, addressing these critical gaps. The strategy involves employing adversarial perturbations on the ID (In-Distribution) dataset to enhance the model's resilience to distribution shifts, thereby simulating potential real-world scenarios characterized by imperceptible variations. Additionally, the integration of Maximum Mean Discrepancy (MMD) at the object level effectively discriminates between ID and OOD samples by quantifying distributional differences. For precise OOD detection, a K-nearest neighbors (KNN) algorithm is used during inference to measure similarity between samples and their closest neighbors in the training data. Evaluations on benchmark datasets, including PASCAL VOC and BDD100K as ID, with COCO and Open Images subsets as OOD, demonstrate significant improvements in OOD generalization compared to existing methods. These discoveries underscore the framework's potential to elevate the dependability and flexibility of object recognition systems in practical scenarios, particularly in autonomous vehicles where accurate object detection under diverse conditions is critical for safety. This research contributes to advancing OOD generalization techniques and lays the groundwork for future refinement to address evolving challenges in machine learning applications. The code can be accessed from https://github.com/DeviSPhd/

NICO Challenge: Out-of-Distribution Generalization for Image Recognition Challenges.

NICO++: Towards Better Benchmarking for Domain Generalization

OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization

In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluation

DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization

In Search of Forgotten Domain Generalization

OOD-CV-v2 : An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images

Towards Non-I.I.D. Image Classification: A Dataset and Baselines.

NODI: Out-Of-Distribution Detection with Noise from Diffusion

COCO-O: A Benchmark for Object Detectors under Natural Distribution Shifts

NeuralOOD: Improving Out-of-Distribution Generalization Performance with Brain-machine Fusion Learning Framework

Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data

Unveiling the unseen: novel strategies for object detection beyond known distributions

OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images

A framework for benchmarking class-out-of-distribution detection and its application to ImageNet

Boosting Out-of-distribution Detection with Typical Features

InvariantOODG: Learning Invariant Features of Point Clouds for Out-of-Distribution Generalization

MOODv2: Masked Image Modeling for Out-of-Distribution Detection

Toward a Realistic Benchmark for Out-of-Distribution Detection

1st Place Solution for ECCV 2022 OOD-CV Challenge Image Classification Track

MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalities