Abstract:The vision of a deep learning-empowered non-destructive evaluation technique aligns perfectly with the goal of zero-defect manufacturing, enabling manufacturers to detect and repair defects actively. However, the dearth of data in manufacturing is one of the biggest obstacles to realizing an intelligent defect detection system. This work presents a framework for bridging the data gap in manufacturing using the potential of synthetic datasets generated using the finite element method-based digital twin. The non-destructive technique under consideration is pulse infrared thermography. A large number of synthetic thermographic measurements were generated using 2D axisymmetric transient thermal simulations. The representativeness of synthetic data was thoroughly investigated at various steps of the framework, and the image segmentation model was trained separately on experimental and synthetic datasets. The study results reveal that when carefully rendered, synthetic datasets represent the experimental data well. When evaluated on real-world experimental samples, the segmentation model pre-trained on synthetic datasets generalizes well to the experimental samples. Furthermore, another advantage of synthetic datasets is the ease of labelling a large amount of data. Finally, the robustness assessment of the model was done on two new datasets: one where the complete experimental setup was changed, and the other was an open-source infrared thermography dataset

What problem does this paper attempt to address?

The paper is primarily dedicated to addressing the challenges faced in automated defect detection in the manufacturing industry using deep learning techniques, particularly the issue of data scarcity. Specifically, the research proposes a framework aimed at improving the application of infrared thermography in defect detection by pre-training image segmentation models using synthetic data generated by the Finite Element Method (FEM). The main contributions of the paper include: 1. **Synthetic Data Generation**: Generating a large amount of pulsed thermography (PT) synthetic data using the Finite Element Method, based on the concept of defect characteristics, addressing the computational time issue of transient thermal simulations. 2. **Synthetic Data Representativeness Evaluation**: Comparing synthetic PT measurements with experimental data and improving the representativeness of synthetic data by adding noise, thereby validating the effectiveness of the synthetic dataset. 3. **Image Segmentation Model Training and Validation**: Training and validating the U-Net image segmentation model using Principal Component Thermography (PCT) images, with some images augmented with noise to enhance model performance, demonstrating the advantages of training models with representative and non-redundant synthetic datasets. 4. **Model Generalization Ability Evaluation**: Testing the pre-trained models on synthetic datasets under different experimental settings and on third-party public datasets, validating the generalization ability of the models. In summary, this research provides a comprehensive solution to the problem of data scarcity in the manufacturing industry by generating a large amount of synthetic data, evaluating its representativeness, and training image segmentation models, demonstrating the effectiveness of the models in practical application scenarios.

Synthetic data generation using finite element method to pre-train an image segmentation model for defect detection using infrared thermography

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

Synthetic training data generation for deep learning based quality inspection

Physics Informed Synthetic Image Generation for Deep Learning-Based Detection of Wrinkles and Folds

Physically-based Data Augmentation for Deep Learning-Enabled Automated Visual Inspection of Scratches

Automated defect detection in digital radiography of aerospace welds using deep learning

An Efficient Parametrized Optical Infrared Thermography 3D Finite Element Framework for Computer Vision Applications

Detecting and classifying hidden defects in additively manufactured parts using deep learning and X-ray computed tomography

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

Spatial and temporal deep learning for defect detection with lock-in thermography

Segment Anything in Defect Detection

A Reliability Study on Automated Defect Assessment in Optical Pulsed Thermography

Towards Reducing Data Acquisition and Labeling for Defect Detection using Simulated Data

A Flexible Deep Learning Framework for Thermographic Inspection of Composites

Enhancing Moisture-Induced Defect Detection in Insulated Steel Pipes through Infrared Thermography and Hybrid Dataset

Synthetic X-ray Image Generation for Non-Destructive Testing using Generative Adversarial Networks

Enhancing Generalizability of a Machine Learning Model for Infrared Thermographic Defect Detection by Using 3D Numerical Modeling

Latent Diffusion Models to Enhance the Performance of Visual Defect Segmentation Networks in Steel Surface Inspection

Internal Defect Detection of Structures Based on Infrared Thermography and Deep Learning

A Novel Defect Segmentation for Pulse Infrared Images Based on Improved Fuzzy C-Means Algorithm with Weighted Distance

Synthetic Data for Semantic Segmentation: A Path to Reverse Engineering in Printed Circuit Boards