Abstract:The penetration state of weld joints determines the quality of the weld, but it is limited by space and is often difficult to measure directly. It is typically estimated using available weld process information. This study proposes a Weld Joint Penetration State Sequential Identification algorithm based on the representation learning of weld images (WJPSSI) and makes contributions in the following two aspects: (1) Features are extracted from weld pool images using a self-supervised representation learning method under label-free conditions, addressing the challenge of label acquisition in industrial production; (2) A few-shot timing learning method is established to determine the timing correlation in the evolution process of the penetration state. By establishing a dual-camera visual sensing system with Pulsed Gas Tungsten Arc Welding (GTAW-P) as the application focus, the synchronous collection of weld images and the penetration states of weld joints is completed, and a dataset of sequential melting time — backside weld pool width under various weld conditions is created. This study utilizes an autoencoder model (New-AutoEncoder, NAE) based on the channel attention mechanism for self-supervised representation and feature extraction of the weld pool image. Additionally, a self-attention mechanism is introduced to develop an improved backside weld pool width monitoring model using the Attention-Gated Recurrent Unit (AGRU) for timely prediction of backside weld pool width and penetration state determination. Through model structure optimization, parameter training, and performance verification, the time-series prediction accuracy achieved an RMSE of 0.29 mm across two groups, marking a significant improvement over other prediction methods. Experimental results show that the proposed method sets a new benchmark in the few-shot sequential identification of weld joints.

Weld Joint Penetration State Sequential Identification Algorithm Based on Representation Learning of Weld Images

Weld Penetration State Identification Based on Time Series Multi-Source Data Fusion

Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

Welding Penetration Monitoring for Pulsed GTAW Using Visual Sensor Based on AAM and Random Forests

Weld Penetration in Situ Prediction from Keyhole Dynamic Behavior under Time-Varying VPPAW Pools Via the OS-ELM Model

Deep Learning-Based Detection of Penetration from Weld Pool Reflection Images

Three-Dimensional Weld Pool Monitoring and Penetration State Recognition for Variable-Gap Keyhole Tungsten Inert Gas Welding Based on Stereo Vision

How to Accurately Monitor the Weld Penetration From Dynamic Weld Pool Serial Images Using CNN-LSTM Deep Learning Model?

A Weld Joint Type Identification Method for Visual Sensor Based on Image Features and SVM

Real-time K-TIG Welding Penetration Prediction on Embedded System Using a Segmentation-Lstm Model

Prediction of weld appearance of electron beam deep penetration welding based on visual sensing

Fast Recognition Algorithm of Weld Seam Image under Passive Vision

Real-time Laser Keyhole Welding Penetration State Monitoring Based on Adaptive Fusion Images Using Convolutional Neural Networks

A Welding Seam Identification Method Based On Cross-Modal Perception

Laser Vision-Based Detection of Weld Penetration in GTAW

Recognition of GTAW Weld Penetration Based on the Lightweight Model and Transfer Learning

Weld Beads and Defects Automatic Identification, Localization, and Size Calculation Based on a Lightweight Fully Convolutional Neural Network

Enhancing Weld Inspection Through Comparative Analysis of Traditional Algorithms and Deep Learning Approaches

Real-time Identification of Molten Pool and Keyhole Using a Deep Learning-Based Semantic Segmentation Approach in Penetration Status Monitoring

Weld Penetration Identification with Deep Learning Method Based on Auditory Spectrum Images of Arc Sounds

Penetration prediction of narrow-gap laser welding based on coaxial high dynamic range observation and machine learning