Abstract:Abstract Online monitoring of the welding process is very important to the development of the modern manufacturing industry. However, monitoring welding defects in real-time and with high accuracy is challenging because welding is inherently a dynamic, non-linear process. In this paper, the forming defects generated during the melt Inert-gas welding of sheet steel as the object of research. We propose a multi-task simultaneous monitoring system for welding defects based on the YOLOv5 model, which can achieve highly accurate simultaneous detection of burn-through and weld deviation defects. Firstly, a passive vision system has been designed that can filter out strong arc light interference. In combination with a self-made camera bracket with flexible adjustment and repeatable positioning, clear images of the molten pool can be acquired. Compared to common methods that require a laser for weld deviation detection, all monitoring tasks can be performed with just one charge coupled device camera, significantly reducing the cost of deploying the system. Secondly, to obtain experimental data closer to the industrial field environment. We simulated different degrees of local and continuous burn-through by changing three parameters: welding current, plate thickness, and lap width. Four different deviations: left, right, and tilt were designed to obtain rich weld deviation image data. Finally, based on the above data, we compared several aspects such as detection speed, recognition accuracy, and loss function. The YOLOv5s model with the smallest model parameters was finally selected as the base model. The results show that our proposed multi-task simultaneous monitoring system achieves an average accuracy of 98.84% for the identification of four molten pool states. Burn-through defect and weld deviation detection with more than 50 frames per second can be achieved in the online detection state. This paper can provide some guidance for the online monitoring of the welding manufacturing process.

Weld pool boundary and weld bead shape reconstruction based on passive vision in P-GMAW

Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning

A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments

The reconsitution of the weld pool surface in stationary TIG welding process with filler wire

Vision sensing system and detection of backside image of molten pool in laser-MIG hybrid welding

Modeling and numerical study of the molten pool dynamics during scanning electron beam welding of aluminum alloys: Physical mechanism, prediction and parameter selection

Study on Short-Circuiting GMAW Pool Behavior and Microstructure of the Weld with Different Waveform Control Methods

Sensing and Control of Weld Pool Geometry for Automated GTA Welding

Investigation into keyhole-weld pool dynamic behaviors based on HDR vision sensing of real-time K-TIG welding process through a steel/glass sandwich

Development of a melt pool characteristics detection platform based on multi-information fusion of temperature fields and photodiode signals in plasma arc welding

Detection of Backside Width of Molten Pool in Laser-MIG Hybrid Welding

Detection of reinforcement of multi-bead and multi-layer weld in additive manufacturing based on on-line visual information of weld pool

A vibration-resistant detection method of weld position and gap for seam tracking of Z-weave GMAW

In-Process Monitoring of Lack of Fusion in Ultra-Thin Sheets Edge Welding Using Machine Vision

Online identification of burn-through and weld deviation in sheet lap MIG welding based on YOLOv5

A 3D reconstruction method based on grid laser and gray scale photo for visual inspection of welds

Weld seam profile extraction using top-down visual attention and fault detection and diagnosis via EWMA for the stable robotic welding process

A novel weld-pool-length monitoring method based on pixel analysis in plasma arc additive manufacturing

Weld Joint Penetration State Sequential Identification Algorithm Based on Representation Learning of Weld Images

A Multi-Layer Multi-Pass Weld Bead Cross-Section Morphology Extraction Method Based on Row–Column Grayscale Segmentation

Detection of 3D seam position for GTA welding based on mirror of tungsten electrode in pool