Inspection of Wind Turbine Blades Using Image Deblurring and Deep Learning Segmentation

Jiale Lu,Qingbin Gao,Kai Zhou

DOI: https://doi.org/10.1117/12.3009721

2024-01-01

Abstract:Remote and complex work sites of wind turbines limit the accessibility of the condition assessment. Wind turbine blades are subject to sustained wind load and harsh natural environmental conditions, which are vulnerable to various faults. Robotic-enabled sensing technology appears to be a promising solution for an efficient wind turbine blade inspection. Together with the recent advances in image processing and deep learning segmentation, automated inspection of wind turbine blades becomes possible. Nevertheless, it remains a challenging task to quantify the damage accurately due to the complex condition of images concerning motion blurs. To address this issue, an integrated framework, i.e., the combination of a Deblur Generative Adversarial Network v2 (DeblurGAN-v2) and You Only Look Once v8 (YOLO-v8) was proposed in this study. Specifically, the mapping between the motion-blurred images and those in high quality was adopted from the open-access pretrained DeblurGAN-v2, based on which the deblurring performance for wind turbine images with various motion blur scales was discussed concerning the image quality. Subsequently, the transfer learning method was implemented to fine-tune YOLO-v8. The well-trained YOLO v8 was then utilized for target defect segmentation on the deblurred images. Finally, various metrics were calculated to evaluate the segmentation accuracy and efficiency. Results prove a good generalization of DeblurGAN-v2 on wind turbine images and clearly illustrate the enhanced performance of the proposed methodology especially when the motion blur scale is within 35. The integrated framework could serve as a reference for dealing with other fuzzy image-related issues.