Abstract:Normal production processes will be substantially impacted by industrial devices in abnormal working conditions. Anomaly sound detection (ASD) model can monitor the working condition of devices by the non-contact and non-invasive way. When new device data is introduced, traditional ASD models are trained using data from all devices, to accommodate every device. However, in real-world settings, the kinds and amounts of devices are constantly changing, which raises difficulties for the current ASD models. This paper proposes a teacher-student incremental learning method for ASD models, aiming to solve ASD model scalability problem. In this paradigm, teacher model has knowledge of all the old devices. The objective of student model is to learn new device knowledge, while avoiding the forgetting of old device knowledge. When student model learns new device data, teacher model transfers the acoustic feature knowledge of old devices to student model via knowledge distillation. Furthermore, the imbalance between old and new knowledge causes challenges, such as knowledge forgetting or lower learning efficiency for student model. This paper presents a dual-teacher-student (DTS) model to solve the problem of knowledge imbalance. Different teacher models for new and old devices in DTS, directing student model to accomplish continuous and deep integration of knowledge. Evaluation for proposed method on the DCASE 2020 Task2 dataset. The results show, the proposed method outperforms other methods in terms of learning capability and robustness during the incremental learning process. Analysis of significance test on the experimental results demonstrates that the method outperforms other methods statistically.

Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Using Classification-Based Methods

Machine Anomalous Sound Detection Based on Self-Supervised Classification

Anomalous Sound Detection as a Simple Binary Classification Problem with Careful Selection of Proxy Outlier Examples

Exploring Large Scale Pre-Trained Models for Robust Machine Anomalous Sound Detection

Description and Discussion on DCASE 2023 Challenge Task 2: First-Shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoring

Representation Learning Using Machine Attribute Information for Anomalous Sound Detection in Real Scenarios

Description and Discussion on DCASE 2022 Challenge Task 2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Applying Domain Generalization Techniques

Transformer-based Autoencoder with ID Constraint for Unsupervised Anomalous Sound Detection

Description and Discussion on DCASE 2024 Challenge Task 2: First-Shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoring

Outlier-aware Inlier Modeling and Multi-scale Scoring for Anomalous Sound Detection via Multitask Learning

Autoencoder with Group-based Decoder and Multi-task Optimization for Anomalous Sound Detection

First-Shot Unsupervised Anomalous Sound Detection With Unknown Anomalies Estimated by Metadata-Assisted Audio Generation

Stream-based Active Learning for Anomalous Sound Detection in Machine Condition Monitoring

Noisy-ArcMix: Additive Noisy Angular Margin Loss Combined With Mixup Anomalous Sound Detection

Improving Anomalous Sound Detection via Low-Rank Adaptation Fine-Tuning of Pre-Trained Audio Models

Anomalous Sound Detection using Audio Representation with Machine ID based Contrastive Learning Pretraining

Hierarchical Metadata Information Constrained Self-Supervised Learning for Anomalous Sound Detection Under Domain Shift

Anomaly sound detection of industrial devices by using teacher-student incremental continual learning

Anomalous Sound Detection Using Self-Attention-Based Frequency Pattern Analysis of Machine Sounds

Self-Supervised Learning for Anomalous Sound Detection

ASD-Diffusion: Anomalous Sound Detection with Diffusion Models