Abstract:The development of AI has enabled the fault detection of industrial components to be achieved through the combination with deep learning. A detection method combined with deep learning has also emerged for the fault detection of fan blades, such as models based on neural networks using the appearance or sound of the blades. However, the detection model obtained from a single data type often has limitations, such as low accuracy and overfitting. This is also the problem with fan blade detection. In contrast, multimodal data fusion detection models are often more stable. The modality diversity of blade diagnosis is strong, and it can be achieved from multiple modalities such as image, sound, and vibration. To improve the accuracy of fault diagnosis of fan blades, this article proposes a multimodal double-layer detection system (MTDS) based on decision-level and feature-level fusion. The system includes a wind turbine simulation platform and a multimodal detection system. It mainly obtains different modal data of the simulated wind turbine from the image, sound, and vibration signals, including blade images through unmanned aerial vehicle photography, blade vibration signals through electronic vibrators, and blade sound signals through microphones. The highly correlated sound and vibration modal data are fused at the feature level, and a detection model based on the sound and vibration mixed mode is implemented using a sound-vibration-CNN (SV-CNN) proposed in this case. Then, a detection model of the image mode is trained based on the blade image using a Convolution Block Attention Module ResNet (CBAM-ResNet) network. Finally, the detection input of the two modal models is fed into a perceptron to obtain the final prediction result, and the decision-level fusion is implemented to achieve fan blade detection based on multimodal, namely the implementation of MTDS.

A novel transformer-enhanced and acoustic-based approach for wind turbine blade fault detection with integrated system implementation

Damage Mode Identification and Singular Signal Detection of Composite Wind Turbine Blade Using Acoustic Emission

Acoustic monitoring of wind turbine blades using wavelet packet analysis and 1D convolutional neural networks

Wind turbine blade fault detection by acoustic analysis: Preliminary results

Research On Wind Turbine Blade Surface Damage Fault On-Line Monitoring And Diagnosis System

Damage Mode Identification of Composite Wind Turbine Blade under Accelerated Fatigue Loads Using Acoustic Emission and Machine Learning

Acoustic inspection system with unmanned aerial vehicles for wind turbines structure health monitoring

An Intelligent Detection Logic for Fan-Blade Damage to Wind Turbines Based on Mounted-Accelerometer Data

Fault Detection and Diagnosis of Wind Turbine Gearbox Based on Acoustic Analysis

Design and Application of Online Fault Warning and Diagnosis Integrated System for Wind Turbines

Damage Identification of Wind Turbine Blades Using an Adaptive Method for Compressive Beamforming Based on the Generalized Minimax-Concave Penalty Function

An experimental investigation into passive acoustic damage detection for structural health monitoring of wind turbine blades

Fault Detection of Wind Turbine Generator Bearing Using Attention-Based Neural Networks and Voting-Based Strategy

Damage identification of wind turbine blades using the microphone array under different parametric and measuring conditions: A prototype study with laboratory-scale models

Adaptive Optimal Resonance Fault Feature Enhancement for Wind Turbine Based on Frequency Search and Uncertainty Analysis

Study on novel signal processing and simultaneous-fault diagnostic method for wind turbine

Wind Turbine Fault Detection with Multimodule Feature Extraction Network and Adaptive Strategy

AI-enabled and Multimodal Data Driven Smart Health Monitoring of Wind Power Systems: A Case Study

A Remote Online Condition Monitoring and Intelligent Diagnostic System for Wind Turbine.

Acoustic-Signal-Based Damage Detection of Wind Turbine Blades—A Review

Wavelet Package Energy Transmissibility Function and Its Application to Wind Turbine Blade Fault Detection