Abstract:In contemporary machine learning, models often struggle with data distribution variations, severely impacting their out-of-distribution (OOD) generalization and detection capabilities. Current object detection methods, relying on virtual outlier synthesis and class-conditional density estimation, struggle to effectively distinguish OOD samples. They often depend on accurate density estimation and may produce virtual outliers that lack realism, particularly in complex or dynamic environments. Furthermore, previous research has typically addressed covariate and semantic shifts independently, resulting in fragmented solutions that fail to comprehensively tackle OOD generalization. This study introduces a unified approach to enhance OOD generalization in object recognition models, addressing these critical gaps. The strategy involves employing adversarial perturbations on the ID (In-Distribution) dataset to enhance the model's resilience to distribution shifts, thereby simulating potential real-world scenarios characterized by imperceptible variations. Additionally, the integration of Maximum Mean Discrepancy (MMD) at the object level effectively discriminates between ID and OOD samples by quantifying distributional differences. For precise OOD detection, a K-nearest neighbors (KNN) algorithm is used during inference to measure similarity between samples and their closest neighbors in the training data. Evaluations on benchmark datasets, including PASCAL VOC and BDD100K as ID, with COCO and Open Images subsets as OOD, demonstrate significant improvements in OOD generalization compared to existing methods. These discoveries underscore the framework's potential to elevate the dependability and flexibility of object recognition systems in practical scenarios, particularly in autonomous vehicles where accurate object detection under diverse conditions is critical for safety. This research contributes to advancing OOD generalization techniques and lays the groundwork for future refinement to address evolving challenges in machine learning applications. The code can be accessed from https://github.com/DeviSPhd/

ObjTest: Object-Level Mutation for Testing Object Detection Systems

Metamorphic Testing for Object Detection Systems

DeepMutation: Mutation Testing of Deep Learning Systems

A Metamorphic Testing Method for Autonomous Driving Systems Based on Scene Mutation

Testing Autonomous Driving System Based on Scenic

Understanding Object Detection Through An Adversarial Lens

Towards Building Self-Aware Object Detectors via Reliable Uncertainty Quantification and Calibration

DPO: Dual-Perturbation Optimization for Test-time Adaptation in 3D Object Detection

Testing Deep Learning Models for Image Analysis Using Object-Relevant Metamorphic Relations

Deep Learning for Hyperspectral Image Classification: A Critical Evaluation via Mutation Testing

OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images

RobOT: Robustness-Oriented Testing for Deep Learning Systems

Improving Testing Coverage for Safety-Critical System by Mutated Specification

DevMuT: Testing Deep Learning Framework Via Developer Expertise-Based Mutation

Object Hider: Adversarial Patch Attack Against Object Detectors

Testing Software Modelling Tools Using Data Mutation.

OOD-CV-v2 : An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images

Uncertainty Evaluation of Object Detection Algorithms for Autonomous Vehicles

Unveiling the unseen: novel strategies for object detection beyond known distributions

What's Wrong with the Robustness of Object Detectors?

Multitest:Physical-Aware Object Insertion for Testing Multi-Sensor Fusion Perception Systems