Abstract:Abstract Online monitoring of the welding process is very important to the development of the modern manufacturing industry. However, monitoring welding defects in real-time and with high accuracy is challenging because welding is inherently a dynamic, non-linear process. In this paper, the forming defects generated during the melt Inert-gas welding of sheet steel as the object of research. We propose a multi-task simultaneous monitoring system for welding defects based on the YOLOv5 model, which can achieve highly accurate simultaneous detection of burn-through and weld deviation defects. Firstly, a passive vision system has been designed that can filter out strong arc light interference. In combination with a self-made camera bracket with flexible adjustment and repeatable positioning, clear images of the molten pool can be acquired. Compared to common methods that require a laser for weld deviation detection, all monitoring tasks can be performed with just one charge coupled device camera, significantly reducing the cost of deploying the system. Secondly, to obtain experimental data closer to the industrial field environment. We simulated different degrees of local and continuous burn-through by changing three parameters: welding current, plate thickness, and lap width. Four different deviations: left, right, and tilt were designed to obtain rich weld deviation image data. Finally, based on the above data, we compared several aspects such as detection speed, recognition accuracy, and loss function. The YOLOv5s model with the smallest model parameters was finally selected as the base model. The results show that our proposed multi-task simultaneous monitoring system achieves an average accuracy of 98.84% for the identification of four molten pool states. Burn-through defect and weld deviation detection with more than 50 frames per second can be achieved in the online detection state. This paper can provide some guidance for the online monitoring of the welding manufacturing process.

Embedded processing methods for online visual analysis of laser welding

An On-line Visual Seam Tracking Sensor System During Laser Beam Welding

Online identification of burn-through and weld deviation in sheet lap MIG welding based on YOLOv5

Supervised deep learning for real-time quality monitoring of laser welding with X-ray radiographic guidance

A Spatio-Temporal Ensemble Deep Learning Architecture for Real-Time Defect Detection during Laser Welding on Low Power Embedded Computing Boards

Progress and Perspectives of In-Situ Optical Monitoring in Laser Beam Welding: Sensing, Characterization and Modeling

Active visual continuous seam tracking based on adaptive feature detection and particle filter tracking

On-line detection system of weld-based rapid prototyping process based on structured light

A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision

A Survey of Process Monitoring Using Computer-Aided Inspection in Laser-Welded Blanks of Light Metals Based on the Digital Twins Concept

Laser Visual Sensing and Process Control in Robotic Arc Welding of Titanium Alloys

In-process Monitoring of Penetration Depth and Contact Width During Laser Lap Welding Using Fused OCT Depth and Coaxial High Speed Image

Real-Time Automatic Detecting System and Online Monitoring Software in Mash Seam Welder

Review of laser welding monitoring

Online Measurement of the Gmaw Process Using Composite Sensor Technology

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Laser welding monitoring techniques based on optical diagnosis and artificial intelligence: a review

Machine Learning-Based In-Process Monitoring for Laser Deep Penetration Welding: A Survey

Online Detection and Evaluation of Weld Surface Defects Based on Lightweight Network VGG16-UNet and Laser Scanning

Introduction to Laser Sensors for Automated Welding

Real-Time Quality Monitoring of Ultrathin Sheets Edge Welding Based on Microvision Sensing and SOCIFS-SVM.