Abstract:We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold. Here, regularized autoencoders provide a popular approach by learning the identity mapping on the set of normal examples, while trying to prevent good reconstruction on points outside of the manifold. Typically, this goal is implemented by controlling the capacity of the model, either directly by reducing the size of the bottleneck layer or implicitly by imposing some sparsity (or contraction) constraints on parts of the corresponding network. However, neither of these techniques does explicitly penalize the reconstruction of anomalous signals often resulting in poor detection. We tackle this problem by adapting a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples. Informally, our training objective regularizes the model to produce locally consistent reconstructions, while replacing irregularities by acting as a filter that removes anomalous patterns. To support this intuition, we perform a rigorous formal analysis of the proposed method and provide a number of interesting insights. In particular, we show that the resulting model resembles a non-linear orthogonal projection of partially corrupted images onto the submanifold of uncorrupted samples. On the other hand, we identify the orthogonal projection as an optimal solution for a number of regularized autoencoders including the contractive and denoising variants. We support our theoretical analysis by empirical evaluation of the resulting detection and localization performance of the proposed method. In particular, we achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.

Why do Angular Margin Losses work well for Semi-Supervised Anomalous Sound Detection?

Why do Angular Margin Losses work well for Semi-Supervised Anomalous Sound Detection?

AdaProj: Adaptively Scaled Angular Margin Subspace Projections for Anomalous Sound Detection with Auxiliary Classification Tasks

Noisy-ArcMix: Additive Noisy Angular Margin Loss Combined With Mixup Anomalous Sound Detection

Anomalous Sound Detection as a Simple Binary Classification Problem with Careful Selection of Proxy Outlier Examples

Low-complexity Attention-based Unsupervised Anomalous Sound Detection exploiting Separable Convolutions and Angular Loss

Improvements of Discriminative Feature Space Training for Anomalous Sound Detection in Unlabeled Conditions

Unsupervised Detection of Anomalous Sound based on Deep Learning and the Neyman-Pearson Lemma

Representational learning for an anomalous sound detection system with source separation model

Discriminative Neighborhood Smoothing for Generative Anomalous Sound Detection

Machine Anomalous Sound Detection Based on Self-Supervised Classification

Self-Supervised Losses for One-Class Textual Anomaly Detection

Robust Audio Anomaly Detection

Outlier-aware Inlier Modeling and Multi-scale Scoring for Anomalous Sound Detection via Multitask Learning

Disentangling Physical Parameters for Anomalous Sound Detection Under Domain Shifts

Analysis of Feature Representations for Anomalous Sound Detection

Learning to Adapt to Domain Shifts with Few-shot Samples in Anomalous Sound Detection

A Contrastive Semi-Supervised Learning Framework For Anomaly Sound Detection.

Stream-based Active Learning for Anomalous Sound Detection in Machine Condition Monitoring

Self-Supervised Training with Autoencoders for Visual Anomaly Detection

Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Using Classification-Based Methods