Abstract:Unsupervised anomalous sound detection, especially self-supervised methods, plays a crucial role in differentiating unknown abnormal sounds of machines from normal sounds. Self-supervised learning can be divided into two main categories: Generative and Contrastive methods. While Generative methods mainly focus on reconstructing data, Contrastive learning methods refine data representations by leveraging the contrast between each sample and its augmented version. However, existing Contrastive learning methods for anomalous sound detection often have two main problems. The first one is that they mostly rely on simple augmentation techniques, such as time or frequency masking, which may introduce biases due to the limited diversity of real-world sounds and noises encountered in practical scenarios (e.g., factory noises combined with machine sounds). The second issue is dimension collapsing, which leads to learning a feature space with limited representation. To address the first shortcoming, we suggest a diffusion-based data augmentation method that employs ChatGPT and AudioLDM. Also, to address the second concern, we put forward a two-stage self-supervised model. In the first stage, we introduce a novel approach that combines Contrastive learning and masked autoencoders to pre-train on the MIMII and ToyADMOS2 datasets. This combination allows our model to capture both global and local features, leading to a more comprehensive representation of the data. In the second stage, we refine the audio representations for each machine ID by employing supervised Contrastive learning to fine-tune the pre-trained model. This process enhances the relationship between audio features originating from the same machine ID. Experiments show that our method outperforms most of the state-of-the-art self-supervised learning methods. Our suggested model achieves an average AUC and pAUC of 94.39% and 87.93% on the DCASE 2020 Challenge Task2 dataset, respectively.

Anomaly Sound Detection of Industrial Equipment Based on Incremental Learning

Anomaly sound detection of industrial devices by using teacher-student incremental continual learning

Stream-based Active Learning for Anomalous Sound Detection in Machine Condition Monitoring

Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Using Classification-Based Methods

Exploring Large Scale Pre-Trained Models for Robust Machine Anomalous Sound Detection

Machine Anomalous Sound Detection Based on Self-Supervised Classification

Integration of Anomaly Machine Sound Detection into Active Noise Control to Shape the Residual Sound.

A Contrastive Semi-Supervised Learning Framework For Anomaly Sound Detection.

Learning to Adapt to Domain Shifts with Few-shot Samples in Anomalous Sound Detection

Context-aware Feature Reconstruction for Class-Incremental Anomaly Detection and Localization

Improving Anomalous Sound Detection via Low-Rank Adaptation Fine-Tuning of Pre-Trained Audio Models

Deep-Learning-Based Approach to Anomaly Detection Techniques for Large Acoustic Data in Machine Operation

Audio-based Anomaly Detection in Industrial Machines Using Deep One-Class Support Vector Data Description

A Machine Anomalous Sound Detection Method Using the Lms Spectrogram and ES-MobileNetV3 Network

Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Incremental Novelty Identification from Initially One-Class Learning to Unknown Abnormality Classification

Unsupervised Adversarial Domain Adaptation Abnormal Sound Detection for Machine Condition Monitoring under Domain Shift Conditions

Outlier-aware Inlier Modeling and Multi-scale Scoring for Anomalous Sound Detection via Multitask Learning

Enhancing Sound-Based Anomaly Detection Using Deep Denoising Autoencoder

Regularized Contrastive Masked Autoencoder Model for Machinery Anomaly Detection Using Diffusion-Based Data Augmentation

Representation Learning Using Machine Attribute Information for Anomalous Sound Detection in Real Scenarios