Abstract:Automated surface defect detection is essential to manufacturing automation. However, automated inspection of aero-engine blades remains challenging due to tiny defects and weak features. To address this issue, we propose a semantic prior guided defect perception network, named SPDP-Net, which is ultimately integrated into an automated system to achieve efficient detection of defects. Firstly, a semantic prior mining module (SPM) is developed to capture finer-grained pixel-level location priors of defects by leveraging image feature mapping relations which facilitates the precise perception of tiny defects. Subsequently, we propose a defect enhancement perception module (DEP) to separate weak defects from complex backgrounds by utilizing defect location priors provided by SPM to enhance the features of defects while suppressing the values of non-defect regions, which makes the weak defects present as more obvious outliers. Finally, the global information extraction module (GIE) extracts the global features of defects, which helps to further improve the predicted results. When equipped with SPM, DEP and GIE, SPDP-Net can accurately identify and locate defects, exhibiting more competitive recognition and feature extraction capabilities for tiny defects and weak defects. To evaluate the effectiveness of our method, we construct an aero-engine blade surface defect detection dataset from real industrial scenarios called ABSDD with the collaboration of senior engineers. We achieve 95.9% precision, 94.0% recall and 94.9% F1 score on ABSDD. In addition, we also achieve state-of-the-art results on two public benchmark datasets, KSDD2 and DAGM. Finally, we have applied the developed SPDP-Net to an automated system and have conducted actual tests in collaboration with a well-known aero-engine production company. Note to Practitioners—At present, the automated detection system for surface defects in industrial manufacturing has not been well developed, which is particularly trailing behind in the field of aero-engine manufacturing. To the best of our knowledge, the surface defect detection of aero-engine blades is still carried out manually. To address this problem, we propose SPDP-Net for the automated detection of surface defects in aero-engine blades. It can accurately perceive and capture tiny and weak defects with excellent performance. SPDP-Net achieves state-of-the-art results on three tasks from different industrial manufacturing fields, which demonstrates its good transfer application capabilities. In addition, we integrate SPDP-Net into an automated detection system consisting of an autonomous imaging system and a high-performance computing server and conduct actual tests in an aero-engine production company. The test achieves remarkable results, indicating the good application prospects of the automated detection system.

Three-Dimensional Image Inpainting System Using 3D-ED-GAN for Efficient Vision-Based Detection for Rotor Dynamic Balance System

RSG-Net: A Recurrent Similarity Network with Ghost Convolution for Wheelset Laser Stripe Image Inpainting

Virtual View Generation Based on 3D-Dense-attentive GAN Networks

Adaptive Vision-Based Method for Rotor Dynamic Balance System

Integration of Deep Learning Network and Robot Arm System for Rim Defect Inspection Application

Performance analysis of genetically optimized 1D-convolutional neural network architecture for rotor system fault detection and diagnosis

Intelligent Fault Diagnosis of Rotor-Bearing System Under Varying Working Conditions With Modified Transfer Convolutional Neural Network and Thermal Images

Real-Time Accurate Deep Learning-Based Edge Detection for 3-D Pantograph Pose Status Inspection

Real-Time Quality Inspection of Motor Rotor Using Cost-Effective Intelligent Edge System

Modified Gaussian convolutional deep belief network and infrared thermal imaging for intelligent fault diagnosis of rotor-bearing system under time-varying speeds

A novel multi-exposure fusion-induced stripe inpainting method for blade reflection-encoded images

High-efficiency automated triaxial robot grasping system for motor rotors using 3D structured light sensor

Deep learning-based borescope image processing for aero-engine blade in-situ damage detection

Deep learning-based inpainting of high dynamic range fringe pattern for high-speed 3D measurement of industrial metal parts

SPDP-Net: A Semantic Prior Guided Defect Perception Network for Automated Aero-Engine Blades Surface Visual Inspection

Enhanced generative adversarial networks for fault diagnosis of rotating machinery with imbalanced data

A Comparative Analysis of Deep Learning Convolutional Neural Network Architectures for Fault Diagnosis of Broken Rotor Bars in Induction Motors

A three-stage GAN model based on edge and color prediction for image outpainting

Image-Decomposition-Enhanced Deep Learning for Detection of Rotor Cores in Cardiac Fibrillation

Genetically Optimised SMOTE-based Adversarial Discriminative Domain Adaptation for Rotor Fault Diagnosis at Variable Operating Conditions

A visual measurement algorithm for vibration displacement of rotating body using semantic segmentation network