Abstract:This work aims at automatically tracking the weld pool boundary to monitor the process and collect operation and process data for analysis and modeling of the operator. The strong arc radiation and less predictable operation add challenges. It is relatively difficult to design a static feature pattern to consistently detect the weld pool boundary/position under different welding conditions. A deep learning network, such as a conventional neural network (CNN), could provide a solution. However, its training requires large amount of data. In a classification problem where each image corresponds to one label, an automated method may be available to calculate the needed labels. Unfortunately, for the problem of image segmentation being addressed in this study, i.e., detecting the weld pool, the labels cannot be generated automatically or the problem would have been solvable by conventional image processing. An effective deep learning approach that does not require large datasets is needed. As such, we propose to use an architecture of the U-Net, which extracts contextual information by combining low-level feature maps with high-levels. It not only can be trained end-to-end from few images to perform well but is also known for its capability to be real-time. To train the network, various welding experiments have been conducted by randomly changing the welding current and welding speed. Various weld pool boundaries/shapes are generated under various welding conditions. As such, the data is representative to better ensure the reliability and robustness of the trained network. Experimental results verified that the trained network can detect the weld pool boundary under various conditions accurately in different welding current, welding speed, and weld pool shape.

Online monitoring system for welding states of bottom-locking joints in high-speed trains via multi-information fusion and 3DCNN

Online Visual Monitoring Method for Liquid Rocket Engine Nozzle Welding Based on a Multi-Task Deep Learning Model

Weld seam object detection system based on the fusion of 2D images and 3D point clouds using interpretable neural networks

Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

Multi-Output Monitoring of High-Speed Laser Welding State Based on Deep Learning

Defect monitoring of high-power laser-arc hybrid welding process based on an improved channel attention convolutional neural network

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Monitoring of distance between laser beam and arc in laser-arc hybrid welding based on deep learning

AF-FTTSnet: An end-to-end two-stream convolutional neural network for online quality monitoring of robotic welding

Monitoring of Single-Track Melting States Based on Photodiode Signal during Laser Powder Bed Fusion

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

How to Accurately Monitor the Weld Penetration From Dynamic Weld Pool Serial Images Using CNN-LSTM Deep Learning Model?

Robust seam tracking via a deep learning framework combining tracking and detection

Detection of solidification crack formation in laser beam welding videos of sheet metal using neural networks

Online Path Recognition for Additive Manufacturing and Arc Welding with Filler Wire Based on Multi-vision Information Fusion

In situ monitoring and penetration prediction of plasma arc welding based on welder intelligence-enhanced deep random forest fusion

Intelligent Seam Tracking in Foils Joining Based on Spatial–temporal Deep Learning from Molten Pool Serial Images

Real-time recognition of arc weld pool using image segmentation network

Deep learning-based monitoring system for predicting top and bottom bead widths during the laser welding of aluminum alloy

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

3D reconstruction method of welding area by fusion of coding raster and semantic segmentation network