Abstract:Unsupervised anomalous sound detection, especially self-supervised methods, plays a crucial role in differentiating unknown abnormal sounds of machines from normal sounds. Self-supervised learning can be divided into two main categories: Generative and Contrastive methods. While Generative methods mainly focus on reconstructing data, Contrastive learning methods refine data representations by leveraging the contrast between each sample and its augmented version. However, existing Contrastive learning methods for anomalous sound detection often have two main problems. The first one is that they mostly rely on simple augmentation techniques, such as time or frequency masking, which may introduce biases due to the limited diversity of real-world sounds and noises encountered in practical scenarios (e.g., factory noises combined with machine sounds). The second issue is dimension collapsing, which leads to learning a feature space with limited representation. To address the first shortcoming, we suggest a diffusion-based data augmentation method that employs ChatGPT and AudioLDM. Also, to address the second concern, we put forward a two-stage self-supervised model. In the first stage, we introduce a novel approach that combines Contrastive learning and masked autoencoders to pre-train on the MIMII and ToyADMOS2 datasets. This combination allows our model to capture both global and local features, leading to a more comprehensive representation of the data. In the second stage, we refine the audio representations for each machine ID by employing supervised Contrastive learning to fine-tune the pre-trained model. This process enhances the relationship between audio features originating from the same machine ID. Experiments show that our method outperforms most of the state-of-the-art self-supervised learning methods. Our suggested model achieves an average AUC and pAUC of 94.39% and 87.93% on the DCASE 2020 Challenge Task2 dataset, respectively.

Anomalous Sound Detection Using Self-Attention-Based Frequency Pattern Analysis of Machine Sounds

Machine Anomalous Sound Detection Based on Self-Supervised Classification

FEATURE BASED FUSION SYSTEM FOR ANOMALOUS SOUNDS MONITORING Technical Report

Machine Anomalous Sound Detection Using Spectral-temporal Modulation Representations Derived from Machine-specific Filterbanks

A Machine Anomalous Sound Detection Method Using the Lms Spectrogram and ES-MobileNetV3 Network

Implementation of Abnormal Sound Detection in Intelligent Surveillance Front-end System

A Dual-Path Framework with Frequency-and-Time Excited Network for Anomalous Sound Detection

Anomalous Sound Detection using Audio Representation with Machine ID based Contrastive Learning Pretraining

Domain Shift-oriented Machine Anomalous Sound Detection Model Based on Self-Supervised Learning

Exploring Large Scale Pre-Trained Models for Robust Machine Anomalous Sound Detection

The Impact of Frequency Bands on Acoustic Anomaly Detection of Machines using Deep Learning Based Model

Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Using Classification-Based Methods

Regularized Contrastive Masked Autoencoder Model for Machinery Anomaly Detection Using Diffusion-Based Data Augmentation

Self-supervised Complex Network for Machine Sound Anomaly Detection

Time-weighted Frequency Domain Audio Representation with GMM Estimator for Anomalous Sound Detection

Self-supervised representation learning for unsupervised anomalous sound detection under domain shift

Spectro Temporal Fusion with CLSTM-Autoencoder based approach for Anomalous Sound Detection

Anomalous sound event detection: A survey of machine learning based methods and applications

Anomaly Sound Detection of Industrial Equipment Based on Incremental Learning

Hierarchical Metadata Information Constrained Self-Supervised Learning for Anomalous Sound Detection Under Domain Shift

First-Shot Unsupervised Anomalous Sound Detection With Unknown Anomalies Estimated by Metadata-Assisted Audio Generation