Abstract:Aircraft maintenance plays a key role in the safety of air transport. One of its most significant procedures is the visual inspection of the aircraft skin for defects. This is mainly carried out manually and involves a high skilled human walking around the aircraft. It is very time consuming, costly, stressful and the outcome heavily depends on the skills of the inspector. In this paper, we propose a two-step process for automating the defect recognition and classification from visual images. The visual inspection can be carried out with the use of an unmanned aerial vehicle (UAV) carrying an image sensor to fully automate the procedure and eliminate any human error. With our proposed method in the first step, we perform the crucial part of recognizing the defect. If a defect is found, the image is fed to an ensemble of classifiers for identifying the type. The classifiers are a combination of different pretrained convolution neural network (CNN) models, which we retrained to fit our problem. For achieving our goal, we created our own dataset with defect images captured from aircrafts during inspection in TUI's maintenance hangar. The images were preprocessed and used to train different pretrained CNNs with the use of transfer learning. We performed an initial training of 40 different CNN architectures to choose the ones that best fitted our dataset. Then, we chose the best four for fine tuning and further testing. For the first step of defect recognition, the DenseNet201 CNN architecture performed better, with an overall accuracy of 81.82%. For the second step for the defect classification, an ensemble of different CNN models was used. The results show that even with a very small dataset, we can reach an accuracy of around 82% in the defect recognition and even 100% for the classification of the categories of missing or damaged exterior paint and primer and dents.

Artificial Dataset Generation for Automated Aircraft Visual Inspection

Synthetic Data Augmentation Using Multiscale Attention CycleGAN for Aircraft Detection in Remote Sensing Images

Image Generation for Efficient Neural Network Training in Autonomous Drone Racing

Research on the Application of Generative Adversarial Networks in Aerial Image Generation

Using Convolutional Neural Networks to Automate Aircraft Maintenance Visual Inspection

GINA-3D: Learning to Generate Implicit Neural Assets in the Wild

Training Datasets Generation for Machine Learning: Application to Vision Based Navigation

Generative Model-Driven Synthetic Training Image Generation: An Approach to Cognition in Rail Defect Detection

LiDAR Sensor modeling and Data augmentation with GANs for Autonomous driving

Learning-Based Defect Recognitions for Autonomous UAV Inspections

Leveraging Synthetic Data in Object Detection on Unmanned Aerial Vehicles

Scalable Modular Synthetic Data Generation for Advancing Aerial Autonomy

CarFree: Hassle-Free Object Detection Dataset Generation Using Carla Autonomous Driving Simulator

SoilingNet: Soiling Detection on Automotive Surround-View Cameras

Drone-based Generation of Sensor Reference and Training Data for Highly Automated Vehicles

Defects Recognition Algorithm Development from Visual UAV Inspections

An Improved Deep Convolutional Neural Network-Based Autonomous Road Inspection Scheme Using Unmanned Aerial Vehicles

Validating Synthetic Data for Perception in Autonomous Airport Navigation Tasks

Generative Model-Driven Synthetic Training Image Generation: An Approach to Cognition in Railway Defect Detection

Fine-Grained Vehicle Perception via 3D Part-Guided Visual Data Augmentation

Initialisation of Autonomous Aircraft Visual Inspection Systems via CNN-Based Camera Pose Estimation