Abstract:Welding is an extensively used technique in manufacturing, and as for every other process, there is the potential for defects in the weld joint that could be catastrophic to the manufactured products. Different welding processes use different parameter settings, which greatly impact the quality of the final welded products. The focus of research in weld defect detection is to develop a non-destructive testing method for weld quality assessment based on observing the weld with an RGB camera. Deep learning techniques have been widely used in the domain of weld defect detection in recent times, but the majority of them use, for example, X-ray images. An RGB image-based solution is attractive, as RGB cameras are comparatively inexpensive compared to X-ray image solutions. However, the number of publicly available RGB image datasets for weld defect detection is comparatively lower than that of X-ray image datasets. This work achieves a complete weld quality assessment involving lap shear strength prediction and visual weld defect detection from an extremely limited dataset. First, a multimodal dataset is generated by the fusion of image data features extracted using a convolutional autoencoder (CAE) designed in this experiment and input parameter settings data. The fusion of the dataset reduced lap shear strength (LSS) prediction errors by 34% compared to prediction errors using only input parameter settings data. This is a promising result, considering the extremely small dataset size. This work also achieves visual weld defect detection on the same limited dataset with the help of an ultrasonic weld defect dataset generated using offline and online data augmentation. The weld defect detection achieves an accuracy of 74%, again a promising result that meets standard requirements. The combination of lap shear strength prediction and visual defect detection leads to a complete inspection to avoid premature failure of the ultrasonic weld joints. The weld defect detection was compared against the publicly available image dataset for surface defect detection.

Deep learning assisted vision inspection of resistance spot welds

Deep Network-Assisted Quality Inspection of Laser Welding on Power Battery

Autonomous nondestructive evaluation of resistance spot welded joints

Deep Learning-Based Defects Detection in Keyhole TIG Welding with Enhanced Vision

Ultrasonic Weld Quality Inspection Involving Strength Prediction and Defect Detection in Data-Constrained Training Environments

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

A High-Performance Deep Learning Algorithm for the Automated Optical Inspection of Laser Welding

Automatic Detection of Welding Defects Using Deep Neural Network

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

Enhancing Weld Inspection Through Comparative Analysis of Traditional Algorithms and Deep Learning Approaches

Automatic Detection and Location of Weld Beads With Deep Convolutional Neural Networks

Semi-supervised transfer learning-based automatic weld defect detection and visual inspection

Approaches for Accuracy Improvement of the X-ray Image Defect Detection of Automobile Casting Aluminum Parts Based on Deep Learning

Weld Image Recognition Based on Deep Learning

Online detection of weld surface defects based on improved incremental learning approach

Online quality inspection of resistance spot welding for automotive production lines

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

Integrated application model for visual detection of welding quality based on visual neuron under edge-end collaboration

Efficient Object Detection and Recognition of Body Welding Studs Based on Improved YOLOv7

LF-YOLO: A Lighter and Faster YOLO for Weld Defect Detection of X-Ray Image

Industrial Laser Welding Defect Detection and Image Defect Recognition Based on Deep Learning Model Developed