Abstract:The development of AI has enabled the fault detection of industrial components to be achieved through the combination with deep learning. A detection method combined with deep learning has also emerged for the fault detection of fan blades, such as models based on neural networks using the appearance or sound of the blades. However, the detection model obtained from a single data type often has limitations, such as low accuracy and overfitting. This is also the problem with fan blade detection. In contrast, multimodal data fusion detection models are often more stable. The modality diversity of blade diagnosis is strong, and it can be achieved from multiple modalities such as image, sound, and vibration. To improve the accuracy of fault diagnosis of fan blades, this article proposes a multimodal double-layer detection system (MTDS) based on decision-level and feature-level fusion. The system includes a wind turbine simulation platform and a multimodal detection system. It mainly obtains different modal data of the simulated wind turbine from the image, sound, and vibration signals, including blade images through unmanned aerial vehicle photography, blade vibration signals through electronic vibrators, and blade sound signals through microphones. The highly correlated sound and vibration modal data are fused at the feature level, and a detection model based on the sound and vibration mixed mode is implemented using a sound-vibration-CNN (SV-CNN) proposed in this case. Then, a detection model of the image mode is trained based on the blade image using a Convolution Block Attention Module ResNet (CBAM-ResNet) network. Finally, the detection input of the two modal models is fed into a perceptron to obtain the final prediction result, and the decision-level fusion is implemented to achieve fan blade detection based on multimodal, namely the implementation of MTDS.

Deep Learning-Based Fault Diagnosis for Marine Centrifugal Fan

Fault diagnosis method of marine centrifugal fan based on adversarial network learning

A Novel Fault Diagnosis Method for Marine Blower with Vibration Signals

Deep Learning-Based Composite Fault Diagnosis

A nearly end-to-end deep learning approach to fault diagnosis of wind turbine gearboxes under nonstationary conditions

A Bearing Fault Diagnosis Method Based on Improved Mutual Dimensionless and Deep Learning

Fault Diagnosis Method of Rotating Machinery Based on CEEMDAN-LSTM Model

Fault Diagnosis of Marine Diesel Engine Based on Multi-scale Time Domain Decomposition and Convolutional Neural Network

Fault Diagnosis of Wind Turbine Bearings Based on CEEMDAN-GWO-KELM

Intelligent fault diagnosis of rotating machinery based on deep learning with feature selection

AI-enabled and Multimodal Data Driven Smart Health Monitoring of Wind Power Systems: A Case Study

Fault Diagnosis for Motor Bearings via an Intelligent Strategy Combined with Signal Reconstruction and Deep Learning

A Study on Deep Learning-Based Fault Diagnosis and Classification for Marine Engine System Auxiliary Equipment

Effective Fault Diagnosis Based on Wavelet and Convolutional Attention Neural Network for Induction Motors

Bearing Fault Diagnosis Method Based on Deep Convolutional Neural Network and Random Forest Ensemble Learning

Fusion of Multi-Layer Attention Mechanisms and CNN-LSTM for Fault Prediction in Marine Diesel Engines

An EEMD and convolutional neural network based fault diagnosis method in intelligent power plant

Fault Diagnosis for Centrifugal Pumps Using Deep Learning and Softmax Regression

Fault diagnosis of mine main ventilator based on multi-eigenvalue selection and data fusion

Fault Diagnosis in Centrifugal Pumps: A Dual-Scalogram Approach with Convolution Autoencoder and Artificial Neural Network

Fault Diagnosis of Wind Turbine Based on Convolution Neural Network Algorithm