Abstract:Machine anomalous sound detection (ASD) has emerged as one of the most promising applications in the Industrial Internet of Things (IIoT) due to its unprecedented efficacy in mitigating risks of malfunctions and promoting production efficiency. Previous works mainly investigated the machine ASD task under centralized settings. However, developing the ASD system under decentralized settings is crucial in practice, since the machine data are dispersed in various factories and the data should not be explicitly shared due to privacy concerns. To enable these factories to cooperatively develop a scalable ASD model while preserving their privacy, we propose a novel framework named CoopASD, where each factory trains an ASD model on its local dataset, and a central server aggregates these local models periodically. We employ a pre-trained model as the backbone of the ASD model to improve its robustness and develop specialized techniques to stabilize the model under a completely non-iid and domain shift setting. Compared with previous state-of-the-art (SOTA) models trained in centralized settings, CoopASD showcases competitive results with negligible degradation of 0.08%. We also conduct extensive ablation studies to demonstrate the effectiveness of CoopASD.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to develop an effective machine Anomaly Sound Detection (ASD) model in a decentralized setting while protecting the data privacy of each factory in the context of the Industrial Internet of Things (IIoT). Specifically, the paper addresses the following two key issues: 1. **Non - iid (Non - independent and Identically Distributed) Data**: Machine types in different factories vary, resulting in training data that is semantically similar but has a large difference in actual distribution. Such non - iid data makes it difficult for the model to converge. 2. **Data Privacy**: Since commercial secrets (such as parameter settings and production plans) can be inferred from machine data, these data cannot be shared among factories. To solve these problems, the authors propose the CoopASD framework, enabling multiple factories to cooperatively train a unified and well - performing ASD model without sharing the original data. CoopASD adopts the Federated Learning (FL) method, in which each factory trains the ASD model on its local data set and periodically uploads the local model to the central server for aggregation. In addition, to deal with the problems of completely non - iid data and domain shift, CoopASD introduces three regularization methods: sampling, selective upload, and early stop to ensure the stability and generalization ability of the model. ### Main Contributions 1. **Proposing the CoopASD Framework**: Enables factories to develop a unified ASD model through cooperation without abnormal samples for training. 2. **Combining Distributed Data and Computational Resources**: Fully utilizes the data and computational resources of each factory while protecting privacy. 3. **Adopting Regularization Methods**: Through techniques such as sampling, selective upload, and early stop, CoopASD can stably converge in a completely non - iid and domain - shift environment. 4. **Performance Close to Centralized Models**: Compared with the latest models in the centralized setting, the performance of CoopASD only drops by 0.08%, showing its competitiveness. ### Experimental Results The experiments were carried out on the data set of DCASE 2023 Task 2, which contains 14 different types of machine audio. The results show that CoopASD performs well on all 14 machine types, with an overall performance reaching 67.65% and a very small gap from the centralized model. In addition, the ablation study verifies the effectiveness of the proposed techniques, indicating that CoopASD has good generalization ability and robustness in a decentralized setting. Through these improvements, CoopASD can not only effectively detect machine abnormal sounds but also protect the data privacy of each factory, which is suitable for large - scale applications in actual industrial scenarios.

CoopASD: Cooperative Machine Anomalous Sound Detection with Privacy Concerns

Anomaly sound detection of industrial devices by using teacher-student incremental continual learning

Improving Anomalous Sound Detection via Low-Rank Adaptation Fine-Tuning of Pre-Trained Audio Models

Machine Anomalous Sound Detection Using Spectral-temporal Modulation Representations Derived from Machine-specific Filterbanks

Distributed collaborative anomalous sound detection by embedding sharing

Real-time Architecture for Audio-Visual Active Speaker Detection.

ASD-Diffusion: Anomalous Sound Detection with Diffusion Models

Robust Active Speaker Detection in Noisy Environments

Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Using Classification-Based Methods

Activity-Guided Industrial Anomalous Sound Detection against Interferences

Stream-based Active Learning for Anomalous Sound Detection in Machine Condition Monitoring

Hybrid Cloud-Edge Collaborative Data Anomaly Detection in Industrial Sensor Networks

Decoupling Detectors for Scalable Anomaly Detection in AIoT Systems with Multiple Machines

Description and Discussion on DCASE 2023 Challenge Task 2: First-Shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoring

Representation Learning Using Machine Attribute Information for Anomalous Sound Detection in Real Scenarios

Noisy-ArcMix: Additive Noisy Angular Margin Loss Combined With Mixup Anomalous Sound Detection

AOC-IDS: Autonomous Online Framework with Contrastive Learning for Intrusion Detection

A Data Privacy Protection Diagnosis Framework for Multiple Machines Vibration Signals Based on a Swarm Learning Algorithm

Distributed IIoT anomaly detection scheme based on blockchain and federated learning

AnoPatch: Towards Better Consistency in Machine Anomalous Sound Detection

Super Learner Ensemble for Anomaly Detection and Cyber-risk Quantification in Industrial Control Systems