Abstract:Unsupervised anomalous sound detection, especially self-supervised methods, plays a crucial role in differentiating unknown abnormal sounds of machines from normal sounds. Self-supervised learning can be divided into two main categories: Generative and Contrastive methods. While Generative methods mainly focus on reconstructing data, Contrastive learning methods refine data representations by leveraging the contrast between each sample and its augmented version. However, existing Contrastive learning methods for anomalous sound detection often have two main problems. The first one is that they mostly rely on simple augmentation techniques, such as time or frequency masking, which may introduce biases due to the limited diversity of real-world sounds and noises encountered in practical scenarios (e.g., factory noises combined with machine sounds). The second issue is dimension collapsing, which leads to learning a feature space with limited representation. To address the first shortcoming, we suggest a diffusion-based data augmentation method that employs ChatGPT and AudioLDM. Also, to address the second concern, we put forward a two-stage self-supervised model. In the first stage, we introduce a novel approach that combines Contrastive learning and masked autoencoders to pre-train on the MIMII and ToyADMOS2 datasets. This combination allows our model to capture both global and local features, leading to a more comprehensive representation of the data. In the second stage, we refine the audio representations for each machine ID by employing supervised Contrastive learning to fine-tune the pre-trained model. This process enhances the relationship between audio features originating from the same machine ID. Experiments show that our method outperforms most of the state-of-the-art self-supervised learning methods. Our suggested model achieves an average AUC and pAUC of 94.39% and 87.93% on the DCASE 2020 Challenge Task2 dataset, respectively.

DP-MAE: A Dual-Path Masked Autoencoder Based Self-Supervised Learning Method for Anomalous Sound Detection

Regularized Contrastive Masked Autoencoder Model for Machinery Anomaly Detection Using Diffusion-Based Data Augmentation

Autoencoder with Group-based Decoder and Multi-task Optimization for Anomalous Sound Detection

Self-supervised representation learning for unsupervised anomalous sound detection under domain shift

Predictive AutoEncoders Are Context-Aware Unsupervised Anomalous Sound Detectors

An Effective Anomalous Sound Detection Method Based on Representation Learning with Simulated Anomalies

A Contrastive Semi-Supervised Learning Framework For Anomaly Sound Detection.

Joint Generative-Contrastive Representation Learning for Anomalous Sound Detection

Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representation

Transformer-based Autoencoder with ID Constraint for Unsupervised Anomalous Sound Detection

Robust Prototype Learning for Anomalous Sound Detection.

Noisy-ArcMix: Additive Noisy Angular Margin Loss Combined With Mixup Anomalous Sound Detection

A Modal-Domain Adaptive Subspace Detector in a Deep-Sea Environment.

Hierarchical Metadata Information Constrained Self-Supervised Learning for Anomalous Sound Detection Under Domain Shift

Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Using Classification-Based Methods

Self-Supervised Learning for Anomalous Sound Detection

Prototype based Masked Audio Model for Self-Supervised Learning of Sound Event Detection

MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition

Machine Anomalous Sound Detection Based on Self-Supervised Classification

Masked Modeling Duo: Towards a Universal Audio Pre-training Framework

Deep Generic Representations for Domain-Generalized Anomalous Sound Detection