Abstract:Structural Health Monitoring, Ahead of Print. Intelligent fault diagnosis based on multisensor data fusion techniques and two-dimensional convolutional neural network (CNN) has been widely developed and achieved numerous excellent results. Existing studies usually develop multi-input models to facilitate data fusion, lacking schemes for realizing the fusion in the process of data-to-image. Traditional methods that convert signals to grayscale maps and concatenate them into RGB images lose temporal correlation and are susceptible to interference. Besides, few studies integrated the favorable features at different stages in the CNN for diagnosis, which limits the diagnostic performance. To this end, this article proposes a multisource signal-to-image method called multidimensional distance matrix (MDM) and a multi-scale adaptive feature fusion convolutional neural network (MAFFCNN). First, MDM images emphasize the interrelationships between points of different moments in time series data and preserve temporal correlation. Then, the conv block of MAFFCNN can extract features at different scales in the image, and its attention branch can better aggregate the location information. Also, the MAFFCNN introduces efficient attention and cross-spatial learning to generate learnable weights based on the importance of features at different stages to achieve adaptive feature fusion. Finally, the above method is validated using the established gear fault dataset and the public bearing dataset. The experimental results demonstrate the effectiveness of the proposed methods and their excellent robustness in complex environments.

In-situ Fault Detection for the Spindle Motor of CNC Machines Via Multi-Stage Residual Fusion Convolution Neural Networks

A Sound and Vibration Fusion Method for Fault Diagnosis of Rolling Bearings under Speed-Varying Conditions.

Cross-speed Spindle Motor Bearings Fault Diagnosis Combined with Multi-Space Variable Scale Adaptive Filter and Feedforward Hybrid Strategy

In-situ fault diagnosis for the harmonic reducer of industrial robots via multi-scale mixed convolutional neural networks

Induction Motor Failure Identification Based on Multiscale Acoustic Entropy Feature Selection and Hierarchical Adaptive Neuro-Fuzzy Inference System with Localized Recurrent Input

Improved DCNN Based on Multi-Source Signals for Motor Compound Fault Diagnosis

A Multi-Input Convolutional Neural Network Model for Electric Motor Mechanical Fault Classification Using Multiple Image Transformation and Merging Methods

A Residual Multihead Self-Attention Network Using Multimodal Shallow Feature Fusion for Motor Fault Diagnosis

CFCNN: A novel convolutional fusion framework for collaborative fault identification of rotating machinery

A Robust Approach of Multi-sensor Fusion for Fault Diagnosis Using Convolution Neural Network

CNN-Based Feature Fusion Motor Fault Diagnosis

A convolutional multisensor fusion fault diagnosis framework based on multidimensional distance matrix for rotating machinery

A multi-scale collaborative fusion residual neural network-based approach for bearing fault diagnosis

Fault Diagnosis for Motor Bearings via an Intelligent Strategy Combined with Signal Reconstruction and Deep Learning

Multi-input CNN based vibro-acoustic fusion for accurate fault diagnosis of induction motor

Motor Fault Diagnosis Based on Short-time Fourier Transform and Convolutional Neural Network

CNC Machine-Bearing Fault Detection Based on Convolutional Neural Network Using Vibration and Acoustic Signal

A novel diagnostic framework based on vibration image encoding and multi-scale neural network

Enhanced Bearing Fault Diagnosis in NC Machine Tools Using Dual-Stream CNN with Vibration Signal Analysis

A Rotating Machinery Fault Diagnosis Method Based on Multi-Sensor Fusion and ECA-CNN