Abstract:Online inspection of welding defects is of great help for welding quality assessment, rapid process optimization, and production efficiency improvement. However, in-situ detection is difficult due to the noisy environments, real-time changes in light, diverse weld forms, and requirements for rapid detection. Traditional defect detection methods face many challenges, such as complex processes, slow speed, insufficient information, and weak adaptability. In this study, an online fast detection method based on laser scanning and a lightweight network is proposed. Firstly, high-precision point clouds of weld surfaces are acquired using a laser displacement sensor. Secondly, equal-interval splitting divides the point cloud of a long-seam weld into equal-resolution subframes for online detection. An image processing algorithm combining radius filtering, Sobel convolution, normalization, and Gaussian enhancement is proposed to convert the split point clouds into high-contrast gray-scale images. With the gray-scale images as input and pixel-level classification of the background and three types of defects as output, a semantic segmentation model, VGG16-UNet, is trained through transfer learning, achieving 88.77 % precision and 92.03 % recall. Based on the prediction result and its mapping point cloud, 3D reconstruction and visualization of defects are realized using Delaunay triangulation. 3D location and geometry dimensions of defects are calculated for defect assessment. Compared with the alternative segmentation models, VGG16-UNet performs better while having a smaller weight (94.95 MB) and a faster inference speed (26.8fps), making it suitable for online industrial applications. The work provides strong support for achieving online automated evaluation of weld surface quality.

On-line Quality Inspection in Laser Blank Welding Using ART2 Neural Network

Online Quality Inspection of Ultrasonic Composite Welding by Combining Artificial Intelligence Technologies with Welding Process Signatures

Quality Assurance of Weld Seams Using Laser Triangulation Imaging and Deep Neural Networks

Post-Weld Quality Inspection for Co(2) Laser Tailored Blank Welding with Vision Sensor

Supervised deep learning for real-time quality monitoring of laser welding with X-ray radiographic guidance

Deep Network-Assisted Quality Inspection of Laser Welding on Power Battery

Online Inspection of Narrow Overlap Weld Quality Using Two-Stage Convolution Neural Network Image Recognition

Real-time Weld Geometry Prediction Based on Multi-Information Using Neural Network Optimized by PCA and GA During Thin-Plate Laser Welding

A Laser-Based Vision System for Weld Quality Inspection

A Weld Quality Inspection System of Auto Parts Based on Machine Vision

Real-Time CU-Net-Based Welding Quality Inspection Algorithm in Battery Production

Real-Time Weld Quality Prediction Using a Laser Vision Sensor in a Lap Fillet Joint during Gas Metal Arc Welding

A Spectroscopic Method Based on Support Vector Machine and Artificial Neural Network for Fiber Laser Welding Defects Detection and Classification

Welding Quality Monitoring of High Frequency Straight Seam Pipe Based on Image Feature

Welding Joints Inspection Via Residual Attention Network

Online quality inspection of resistance spot welding for automotive production lines

Online Detection and Evaluation of Weld Surface Defects Based on Lightweight Network VGG16-UNet and Laser Scanning

Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

Deep Neural Networks for Defects Detection in Gas Metal Arc Welding

Laser-vision-based quality inspection system for small-bead laser welding

Weld image deep learning-based on-line defects detection using convolutional neural networks for Al alloy in robotic arc welding