Abstract:At present, sensor recognition technology has become a research hotspot in welding process monitoring. However, most of the existing defect recognition methods are based on single-sensor information, which hinders the further improvement of recognition accuracy and weakens the anti-interference ability under complex conditions. To overcome the shortcomings of single-sensor recognition technology, multi-source information fusion technology can exploit the advantages of different types of sensors to achieve more comprehensive and accurate monitoring of the welding process. However, given the process of fusion of different information, the feature mining mechanism of the deep learning model is still under-explained, and the direct complementarity of the different information remains unclear. In this paper, we propose a hybrid model that uses the fusion of molten pool image and voltage signals to quickly and accurately identify three types of defects in lap MIG welding: burn -through, weld bias, and uneven width. Firstly, a synchronized trigger device is used to acquire molten pool images and weld voltage information, and the voltage data is sliced and matched with the molten pool image data. Secondly, the Short-Time Fourier Transform (STFT) is applied to explore the frequency variation components in the voltage data, and the resulting time-frequency matrix is transformed into a time spectrogram. Finally, the molten pool image and the time spectrogram are simultaneously fed into the hybrid CNN model for online monitoring of welding defect states. The test results show that the average accuracy of the hybrid CNN model in detecting five different welding states reaches 98.87 %, which is significantly higher than three other models based on single sensor information. The visualization of the confusion matrix and Grad-CAM shows that the hybrid CNN model based on multi-source heterogeneous information has a higher accuracy for detecting the transition states that are difficult to detect in welding, and has a more reasonable mechanism for allocating attention, so it can achieve a more accurate and balanced recognition effect in the whole welding manufacturing process. These studies can provide guidance for quality monitoring of welding processes based on multi-source sensor technology, which can be extended to the field of arc additive monitoring.

Online Pipeline Weld Defect Detection for Magnetic Flux Leakage Inspection System Via Lightweight Rotated Network

A Lightweight Model of Automatic Pixel-Level Detection for Weld Defects

LAD-Net: A lightweight welding defect surface non-destructive detection algorithm based on the attention mechanism

Online Detection and Evaluation of Weld Surface Defects Based on Lightweight Network VGG16-UNet and Laser Scanning

A Magnetic Flux Leakage Detector for Ferromagnetic Pipeline Welds with a Magnetization Direction Perpendicular to the Direction of Travel

Image Classification Method Based on Improved Deep Convolutional Neural Networks for the Magnetic Flux Leakage (MFL) Signal of Girth Welds in Long-Distance Pipelines

A Weld Surface Defect Recognition Method Based on Improved MobileNetV2 Algorithm

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

LF-YOLO: A Lighter and Faster YOLO for Weld Defect Detection of X-Ray Image

On-line Defect Recognition of MIG Lap Welding for Stainless Steel Sheet Based on Weld Image and CMT Voltage: Feature Fusion and Attention Weights Visualization

Weld Beads and Defects Automatic Identification, Localization, and Size Calculation Based on a Lightweight Fully Convolutional Neural Network

Defect detection method for high-resolution weld based on wandering Gaussian and multi-feature enhancement fusion

Attention Module Magnetic Flux Leakage Linked Deep Residual Network for Pipeline In-Line Inspection

Reliability analysis of corroded pipes using MFL signals and Residual Neural Networks

Online detection of weld surface defects based on improved incremental learning approach

A novel method for defects marking and classifying in MFL inspection of pipeline

A Novel Defect Quantification Method Utilizing Multi-Sensor Magnetic Flux Leakage Signal Fusion

A Pipeline Defect Inversion Method With Erratic MFL Signals Based on Cascading Abstract Features

Online Visual Monitoring Method for Liquid Rocket Engine Nozzle Welding Based on a Multi-Task Deep Learning Model

A Single-Stage Enhancement-Identification Framework for Pipeline MFL Inspection