Abstract:Vision-based surface defect detection (SDD) for no-service aero-engine blades provides a fast and effective way to monitor product quality. Most existing detection algorithms for aero-engine blades are 1) based on CNN, including artificially designed non-maximum suppression (NMS) operations, and 2) focus on improving the detection accuracy rather than improving the inference speed and even ignoring the latter. To solve the above problems, we introduce a novel object detection paradigm, DEtection TRansformer (DETR), to design a novel network (SDD-DETR) with high accuracy for the SDD of aero-engine blades. To our knowledge, the paper is the first to introduce the DETR detector to SDD of aero-engine blades. While providing high accuracy, the inference speed of DETR remained slow due to self-attention operation and feed-forward network (FFN). Therefore, two lightweight modules have been designed for SDD of aero-engine blades: a progressive feature input multi-scale deformable attention module (PFI-MSDA) and a lightweight FFN (LW-FFN). PFI-MSDA hierarchically reduces the number of tokens input to the self-attention module, thereby reducing the time complexity of the self-attention layer. LW-FFN shrinks the complexity of multilayer perceptron. In addition, no parameter sharing of the detection head is utilized to compensate for the accuracy drop caused by the lightweight. Experiments verify that our method has the same AP and F1-score as DINO (a DETR-based detector), but our approach is lighter. Compared with DINO, the FLOPs are reduced by 113.4 ${G}$ , the inference speed is increased by 42.4%, and the runtime memory usage is reduced by 5.9 ${G}$ , which allows our method to be trained on low-end GPUs with more batch size, further improving the training efficiency. The code is available at https://github.com/VDT-2048/SDD-DETR. Note to Practitioners —The motivation for this paper is to design a high-precision and high-inference speed visual detection method for the SDD of aero-engine blades. Most high-precision vision methods are based on the transformer framework. However, its high complexity and poor compatibility in deployment environments lead to slower detection speeds. Although the application object in this paper is aero-engine blades, it is also applicable in other fields of industry, such as rail detection, plate and strip steel detection, etc. However, the method proposed cannot be supported by deployment environments such as RKNN because of the deformable attention operator, so it takes a certain amount of time to be deployed and put into practical use. Currently, the frameworks of visual and language large models are based on transformers, consistent with the framework of our method, which makes extending our approach to large visual and multi-modal models more accessible.

Learning to Identify Drilling Defects in Turbine Blades with Single Stage Detectors

A Deep-Learning-Based Approach for Aircraft Engine Defect Detection

Automatic Borescope Damage Assessments for Gas Turbine Blades via Deep Learning

Automatic Image Detection of Multi-Type Surface Defects on Wind Turbine Blades Based on Cascade Deep Learning Network.

Infrared Thermal Imaging-Based Turbine Blade Crack Classification Using Deep Learning

Anomaly Detection on Small Wind Turbine Blades Using Deep Learning Algorithms

Slice-Aided Defect Detection in Ultra High-Resolution Wind Turbine Blade Images

Wind turbine surface damage detection by deep learning aided drone inspection analysis

Learning to identify cracks on wind turbine blade surfaces using drone-based inspection images

Automated Defect Detection in Precision Forging Ultrasonic Images Based on Deep Learning

SDD-DETR: Surface Defect Detection for No-Service Aero-Engine Blades with Detection Transformer

Tiny Defect Detection in High-Resolution Aero-Engine Blade Images via a Coarse-to-Fine Framework

Detecting Surface Defects of Wind Tubine Blades Using an Alexnet Deep Learning Algorithm

Surface Defect Detection of Wind Turbine Blades Based on Vision

Automated defect detection in digital radiography of aerospace welds using deep learning

Research on Nondestructive Testing Technology for Drilling Risers Based on Magnetic Memory and Deep Learning

Deep learning-based borescope image processing for aero-engine blade in-situ damage detection

Automatic Defect Detection of Jet Engine Turbine and Compressor Blade Surface Coatings Using a Deep Learning-Based Algorithm

Detection Transformer with Multi-Scale Fusion Attention Mechanism for Aero-Engine Turbine Blade Cast Defect Detection Considering Comprehensive Features

Micro-defect Varifocal Network: Channel attention and spatial feature fusion for turbine blade surface micro-defect detection