Abstract:When the machinery device operates abnormally, it is not sufficient for fault detection only via extracting fault features from a single sensor due to the latent fault information may be scattered across multiple sensors. Multi-sensory fusion techniques with deep learning framework have attracted increasing attention from researchers due to the exploiting and integration of fault information between multiple sensors. Nevertheless, there are two remaining shortcomings in most existing multi-sensory fusion technologies. (1) Most existing fusion methods merely concentrate on conducting multi-sensory information fusion from time-domain or frequency-domain to achieve fault diagnosis, which are often unsatisfactory in the face of strong noise environments. (2) The collaborative fusion between several vibration sensors is generally considered in the past works, whereas the complementary information fusion between multi-sensory vibro-acoustic heterogeneous data are rarely studied. To address these deficiencies, this paper proposes a novel coarse-to-fine dual-scale time-frequency attention fusion network (CDTFAFN) for machinery fault diagnosis, which not only adequately considers the complementary information fusion of vibro-acoustic signal, but also has robust feature learning capabilities in a noisy scenario. Firstly, the signal-to-image encoding unit (SIEU) containing the improved constant-Q non-stationary Gabor transform (ICQ-NSGT) is introduced to convert the collected raw vibro-acoustic heterogeneous signal into time-frequency representation (TFR) and achieve the coarse-grained feature fusion. Secondly, the time-frequency attention feature fusion unit (TFA-FFU) is designed to concurrently learn the fine-grained features at two scales from the low-level fused features which are meaningful for fault diagnosis. Finally, the coarse-to-fine features are sequentially concatenated and fed into softmax classifier to preferably promote the network learning performance and automatically implement fault classification. The performance of the proposed approach is validated against those state-of-the-art results on two groups of multi-sensory vibro-acoustic data in different experimental platforms. Experiment results show that the proposed method with the diagnosis accuracy of 99 % above outperforms other several representative fusion technologies (i.e., 2MNet, MFF-GBFD, MSCNN-BiLSTM, MFAN-VAF, 1D-CNN-VAF, MI-CNN-TFT and TFFN-VAF) in the raw noise-free addition scenario. Moreover, the average testing accuracy of the proposed method can still reach 97 % above in the noisy scenarios with Gaussian white noises, which shows its competitive superiority and strong robustness against noises in machinery fault diagnosis. According to the five ensemble macro-average performance evaluation metrics (i.e., accuracy, precision, sensitivity, specificity and F1-score) and the receiver operator characteristic (ROC) analysis, our findings also emphasize the superiority of applying our method for machinery fault diagnosis under the colored noises compared with other fusion technologies (i.e., 2MNet, MFF-GBFD, MSCNN-BiLSTM, MFAN-VAF, 1D-CNN-VAF, MI-CNN-TFT and TFFN-VAF) reported in this paper.

GOL-SFSTS Based Few-Shot Learning Mechanical Anomaly Detection Using Multi-Channel Audio Signal

Data anomaly detection for structural health monitoring using a combination network of GANomaly and CNN

Machine Anomalous Sound Detection Using Spectral-temporal Modulation Representations Derived from Machine-specific Filterbanks

Multi-Frequency Augmentation framework via information active capture for machinery intelligent fault diagnosis

Learning to Adapt to Domain Shifts with Few-shot Samples in Anomalous Sound Detection

A deep learning approach for anomaly detection based on SAE and LSTM in mechanical equipment

Cross-Modal Learning for Anomaly Detection in Fused Magnesium Smelting Process: Methodology and Benchmark

Regularized Contrastive Masked Autoencoder Model for Machinery Anomaly Detection Using Diffusion-Based Data Augmentation

Fused Machine Learning Based on Boosting Algorithm for Noise Recognition of Moving Parts in Sealed Cavity

CDTFAFN: A Novel Coarse-to-fine Dual-Scale Time-Frequency Attention Fusion Network for Machinery Vibro-Acoustic Fault Diagnosis

Outlier-aware Inlier Modeling and Multi-scale Scoring for Anomalous Sound Detection via Multitask Learning

MFSFormer: A Novel End-to-End Rotating Machinery Fault Diagnosis Framework for Noise and Small Samples

Semantic Coarse-to-Fine Granularity Learning for Two-Stage Few-Shot Anomaly Detection

Siamese Neural Network Based Few-Shot Learning for Anomaly Detection in Industrial Cyber-Physical Systems

Anomalous Sound Detection Using Self-Attention-Based Frequency Pattern Analysis of Machine Sounds

An Unsupervised Spatiotemporal Fusion Network Augmented with Random Mask and Time-Relative Information Modulation for Anomaly Detection of Machines with Multiple Measuring Points.

MFGAN: Multimodal Fusion for Industrial Anomaly Detection Using Attention-Based Autoencoder and Generative Adversarial Network

Reshaping Bioacoustics Event Detection: Leveraging Few-Shot Learning (FSL) with Transductive Inference and Data Augmentation

Improving Pipeline Magnetic Flux Leakage (MFL) Detection Performance With Mixed Attention Mechanisms (AMs) and Deep Residual Shrinkage Networks (DRSNs)

Bearing Fault Diagnosis by Sparse Frequency Spiral Spectrum Driven NAF-LDM under Strong Noise and Small Samples

A Machine Anomalous Sound Detection Method Using the Lms Spectrogram and ES-MobileNetV3 Network