Data Fusion and Ensemble Learning for Advanced Anomaly Detection Using Multi-Spectral RGB and Thermal Imaging of Small Wind Turbine Blades

Majid Memari,Mohammad Shekaramiz,Mohammad A. S. Masoum,Abdennour C. Seibi
DOI: https://doi.org/10.3390/en17030673
IF: 3.2
2024-02-01
Energies
Abstract:This paper introduces an innovative approach to Wind Turbine Blade (WTB) inspection through the synergistic use of thermal and RGB imaging, coupled with advanced deep learning techniques. We curated a unique dataset of 1000 thermal images of healthy and faulty blades using a FLIR C5 Compact Thermal Camera, which is equipped with Multi-Spectral Dynamic Imaging technology for enhanced imaging. This paper focuses on evaluating 35 deep learning classifiers, with a standout ensemble model combining Vision Transformer (ViT) and DenseNet161, achieving a remarkable 100% accuracy on the dataset. This model demonstrates the exceptional potential of deep learning in thermal diagnostic applications, particularly in predictive maintenance within the renewable energy sector. Our findings underscore the synergistic combination of ViT's global feature analysis and DenseNet161's dense connectivity, highlighting the importance of controlled environments and sophisticated preprocessing for accurate thermal image capture. This research contributes significantly to the field by providing a comprehensive dataset and demonstrating the efficacy of several deep learning models in ensuring the operational efficiency and reliability of wind turbines.
energy & fuels
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to improve the accuracy and efficiency of wind turbine blade (WTBs) detection. Specifically, by combining thermal imaging and RGB imaging technologies and using advanced deep - learning methods, the paper aims to overcome the limitations of traditional detection methods, such as sensitivity to environmental conditions and the shortcomings of single - modal imaging technologies. The following is a specific description of the main problems in the paper: 1. **Improving the accuracy of defect detection**: - Traditional detection methods (such as using only RGB imaging or thermal imaging) have limitations when detecting internal and surface defects of wind turbine blades. These methods often fail to provide a comprehensive assessment, especially in complex and changeable environments. - The paper proposes an innovative method to improve the accuracy of defect detection by fusing thermal imaging and RGB imaging data and combining deep - learning techniques. 2. **Adapting to different environmental conditions**: - Wind turbine blades exhibit different characteristics under different environmental conditions (such as temperature changes, humidity, wind speed, etc.), which pose challenges to defect detection. - Through data fusion and ensemble learning techniques, the method proposed in the paper can better adapt to various environmental conditions and improve the reliability and robustness of detection. 3. **Reducing the false detection rate**: - Single - modal imaging technologies (such as thermal imaging) are easily affected by external factors, leading to false detections and missed detections. For example, reflective surfaces or inconsistent temperatures may cause false anomalies. - By combining the high - resolution visual details provided by RGB imaging and the temperature change detection of thermal imaging, the paper reduces the false detection rate and improves the detection accuracy. 4. **Improving detection efficiency**: - Traditional detection methods usually require a long time and high cost, especially in large - scale wind farms. - The deep - learning model proposed in the paper improves computational efficiency and reduces detection time while maintaining high diagnostic accuracy, thereby reducing maintenance costs. 5. **Providing a comprehensive defect assessment**: - By fusing thermal imaging and RGB imaging data, the paper can not only accurately locate the position of defects but also evaluate the nature of defects in detail, providing multi - dimensional analysis. - This comprehensive assessment helps to more comprehensively understand the condition of wind turbine blades and provides more valuable information for repair and maintenance. In summary, by combining thermal imaging and RGB imaging data and using advanced deep - learning techniques, this paper aims to improve the accuracy, adaptability, reliability, and efficiency of wind turbine blade defect detection, thereby ensuring the efficient operation and safety of wind power generation systems.