Abstract:Object detection is a pivotal task in computer vision that has received significant attention in previous years. Nonetheless, the capability of a detector to localise objects out of the training distribution remains unexplored. Whilst recent approaches in object-level out-of-distribution (OoD) detection heavily rely on class labels, such approaches contradict truly open-world scenarios where the class distribution is often unknown. In this context, anomaly detection focuses on detecting unseen instances rather than classifying detections as OoD. This work aims to bridge this gap by leveraging an open-world object detector and an OoD detector via virtual outlier synthesis. This is achieved by using the detector backbone features to first learn object pseudo-classes via self-supervision. These pseudo-classes serve as the basis for class-conditional virtual outlier sampling of anomalous features that are classified by an OoD head. Our approach empowers our overall object detector architecture to learn anomaly-aware feature representations without relying on class labels, hence enabling truly open-world object anomaly detection. Empirical validation of our approach demonstrates its effectiveness across diverse datasets encompassing various imaging modalities (visible, infrared, and X-ray). Moreover, our method establishes state-of-the-art performance on object-level anomaly detection, achieving an average recall score improvement of over 5.4% for natural images and 23.5% for a security X-ray dataset compared to the current approaches. In addition, our method detects anomalies in datasets where current approaches fail. Code available at <a class="link-external link-https" href="https://github.com/KostadinovShalon/oln-ssos" rel="external noopener nofollow">this https URL</a>.

Anomalib: A Deep Learning Library for Anomaly Detection

Anomalous Example Detection in Deep Learning: A Survey

Learning to Detect Interesting Anomalies

Deep Learning for Anomaly Detection: Challenges, Methods, and Opportunities

Deep Learning for Anomaly Detection: A Review

Deep Learning for Anomaly Detection: A Survey

Anomaly Detection Industrial Items

Anomaly detection using deep learning based model with feature attention

Deep Anomaly Analytics: Advancing the Frontier of Anomaly Detection

GANomaly: Semi-supervised Anomaly Detection via Adversarial Training

Isolation-Based Anomaly Detection

An Anomaly-Introduced Learning Method for Abnormal Event Detection

Anomaly detection in surveillance videos: a thematic taxonomy of deep models, review and performance analysis

Deep anomaly detection on set data: Survey and comparison

Machine Learning for Anomaly Detection: A Systematic Review

A Comprehensive Library for Benchmarking Multi-class Visual Anomaly Detection

Deep Learning for Anomaly Detection in Log Data: A Survey

Anomaly Detection using Principles of Human Perception

AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection

Don't Miss Out on Novelty: Importance of Novel Features for Deep Anomaly Detection

Towards Open-World Object-based Anomaly Detection via Self-Supervised Outlier Synthesis