Abstract:This work aims at automatically tracking the weld pool boundary to monitor the process and collect operation and process data for analysis and modeling of the operator. The strong arc radiation and less predictable operation add challenges. It is relatively difficult to design a static feature pattern to consistently detect the weld pool boundary/position under different welding conditions. A deep learning network, such as a conventional neural network (CNN), could provide a solution. However, its training requires large amount of data. In a classification problem where each image corresponds to one label, an automated method may be available to calculate the needed labels. Unfortunately, for the problem of image segmentation being addressed in this study, i.e., detecting the weld pool, the labels cannot be generated automatically or the problem would have been solvable by conventional image processing. An effective deep learning approach that does not require large datasets is needed. As such, we propose to use an architecture of the U-Net, which extracts contextual information by combining low-level feature maps with high-levels. It not only can be trained end-to-end from few images to perform well but is also known for its capability to be real-time. To train the network, various welding experiments have been conducted by randomly changing the welding current and welding speed. Various weld pool boundaries/shapes are generated under various welding conditions. As such, the data is representative to better ensure the reliability and robustness of the trained network. Experimental results verified that the trained network can detect the weld pool boundary under various conditions accurately in different welding current, welding speed, and weld pool shape.

Real-time Identification of Molten Pool and Keyhole Using a Deep Learning-Based Semantic Segmentation Approach in Penetration Status Monitoring

Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

Real-time recognition of arc weld pool using image segmentation network

Real-time monitoring of weld surface morphology with lightweight semantic segmentation model improved by attention mechanism during laser keyhole welding

How to Accurately Monitor the Weld Penetration From Dynamic Weld Pool Serial Images Using CNN-LSTM Deep Learning Model?

Penetration/keyhole status prediction and model visualization based on deep learning algorithm in plasma arc welding

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

Real-time segmentation network for accurate weld detection in large weldments

Online Visual Monitoring Method for Liquid Rocket Engine Nozzle Welding Based on a Multi-Task Deep Learning Model

Deep Learning-Based Defects Detection in Keyhole TIG Welding with Enhanced Vision

A data-driven time-sequence feature-based composite network of time-distributed CNN-LSTM for detecting pore defects in laser penetration welding

DSNet: A dynamic squeeze network for real-time weld seam image segmentation

TIG Stainless Steel Molten Pool Contour Detection and Weld Width Prediction Based on Res-Seg

Research on welding penetration status monitoring based on Residual-Group convolution model

Recognition of GTAW Weld Penetration Based on the Lightweight Model and Transfer Learning

Penetration prediction of narrow-gap laser welding based on coaxial high dynamic range observation and machine learning

Automatic Detection and Location of Weld Beads With Deep Convolutional Neural Networks

Industrial Laser Welding Defect Detection and Image Defect Recognition Based on Deep Learning Model Developed

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Research on a Feature Point Detection Algorithm for Weld Images Based on Deep Learning