Abstract:The penetration state of weld joints determines the quality of the weld, but it is limited by space and is often difficult to measure directly. It is typically estimated using available weld process information. This study proposes a Weld Joint Penetration State Sequential Identification algorithm based on the representation learning of weld images (WJPSSI) and makes contributions in the following two aspects: (1) Features are extracted from weld pool images using a self-supervised representation learning method under label-free conditions, addressing the challenge of label acquisition in industrial production; (2) A few-shot timing learning method is established to determine the timing correlation in the evolution process of the penetration state. By establishing a dual-camera visual sensing system with Pulsed Gas Tungsten Arc Welding (GTAW-P) as the application focus, the synchronous collection of weld images and the penetration states of weld joints is completed, and a dataset of sequential melting time — backside weld pool width under various weld conditions is created. This study utilizes an autoencoder model (New-AutoEncoder, NAE) based on the channel attention mechanism for self-supervised representation and feature extraction of the weld pool image. Additionally, a self-attention mechanism is introduced to develop an improved backside weld pool width monitoring model using the Attention-Gated Recurrent Unit (AGRU) for timely prediction of backside weld pool width and penetration state determination. Through model structure optimization, parameter training, and performance verification, the time-series prediction accuracy achieved an RMSE of 0.29 mm across two groups, marking a significant improvement over other prediction methods. Experimental results show that the proposed method sets a new benchmark in the few-shot sequential identification of weld joints.

A Novel Penetration State Recognition Method Based on LSTM with Auditory Attention During Pulsed GTAW

Recognition of Penetration States Based on Arc Sound of Interest Using VGG-SE Network During Pulsed GTAW Process

Arc Sound Model for Pulsed GTAW and Recognition of Different Penetration States

Weld Penetration Identification with Deep Learning Method Based on Auditory Spectrum Images of Arc Sounds

Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

Research On Detection Of Welding Penetration State During Robotic Gtaw Process Based On Audible Arc Sound

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

Seam Penetration Recognition for GTAW Using Convolutional Neural Network Based on Time-Frequency Image of Arc Sound

Automated Control of Welding Penetration Based on Audio Sensing Technology

Weld Joint Penetration State Sequential Identification Algorithm Based on Representation Learning of Weld Images

Research on Welding Penetration State Recognition Based on BP-Adaboost Model for Pulse GTAW Welding Dynamic Process

Penetration Feature Extraction and Modeling of Arc Sound Signal in GTAW Based on Wavelet Analysis and Hidden Markov Model

Visual-Acoustic Penetration Recognition in Variable Polarity Plasma Arc Welding Process Using Hybrid Deep Learning Approach

A Novel Convolutional Neural Network Based on Time–Frequency Spectrogram of Arc Sound and Its Application on GTAW Penetration Classification

An end-to-end framework based on acoustic emission for welding penetration prediction

Welding Penetration Monitoring for Pulsed GTAW Using Visual Sensor Based on AAM and Random Forests

Recognition of Penetration State in GTAW Based on Vision Transformer Using Weld Pool Image

Penetration state recognition of MIG welding based on genetic wavelet neural network

Characteristic Analysis and Pattern Recognition of Arc Sound under Typical Penetration Status in MIG Welding

Penetration State Identification of Lap Joints in Gas Tungsten Arc Welding Process Based on Two Channel Arc Sounds

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding