Abstract:At present, sensor recognition technology has become a research hotspot in welding process monitoring. However, most of the existing defect recognition methods are based on single-sensor information, which hinders the further improvement of recognition accuracy and weakens the anti-interference ability under complex conditions. To overcome the shortcomings of single-sensor recognition technology, multi-source information fusion technology can exploit the advantages of different types of sensors to achieve more comprehensive and accurate monitoring of the welding process. However, given the process of fusion of different information, the feature mining mechanism of the deep learning model is still under-explained, and the direct complementarity of the different information remains unclear. In this paper, we propose a hybrid model that uses the fusion of molten pool image and voltage signals to quickly and accurately identify three types of defects in lap MIG welding: burn -through, weld bias, and uneven width. Firstly, a synchronized trigger device is used to acquire molten pool images and weld voltage information, and the voltage data is sliced and matched with the molten pool image data. Secondly, the Short-Time Fourier Transform (STFT) is applied to explore the frequency variation components in the voltage data, and the resulting time-frequency matrix is transformed into a time spectrogram. Finally, the molten pool image and the time spectrogram are simultaneously fed into the hybrid CNN model for online monitoring of welding defect states. The test results show that the average accuracy of the hybrid CNN model in detecting five different welding states reaches 98.87 %, which is significantly higher than three other models based on single sensor information. The visualization of the confusion matrix and Grad-CAM shows that the hybrid CNN model based on multi-source heterogeneous information has a higher accuracy for detecting the transition states that are difficult to detect in welding, and has a more reasonable mechanism for allocating attention, so it can achieve a more accurate and balanced recognition effect in the whole welding manufacturing process. These studies can provide guidance for quality monitoring of welding processes based on multi-source sensor technology, which can be extended to the field of arc additive monitoring.

Intelligent Classification of Tungsten Inert Gas Welding Defects: A Transfer Learning Approach

Deep learning-based weld defect classification using VGG16 transfer learning adaptive fine-tuning

Deep Learning-Based Defects Detection in Keyhole TIG Welding with Enhanced Vision

Passive machine vision-based defect classification in tungsten inert gas welding on SS304 using AI-based gradient descent algorithm

Narrow Gap GTAW Defect Detection and Classification Based on Transfer Learning of Generative Adversarial Networks

Weld Defect Detection and Image Defect Recognition Using Deep Learning Technology

Online detection of weld surface defects based on improved incremental learning approach

A Defect Classification Algorithm for Gas Tungsten Arc Welding Process Based on Unsupervised Learning and Few-Shot Learning Strategy

Weld Defect Images Classification with VGG16-Based Neural Network.

Deep Neural Networks for Defects Detection in Gas Metal Arc Welding

Semi-supervised transfer learning-based automatic weld defect detection and visual inspection

Deep Learning Approach for Defective Spot Welds Classification Using Small and Class-Imbalanced Datasets.

Industrial Laser Welding Defect Detection and Image Defect Recognition Based on Deep Learning Model Developed

Weld Defect Detection Based on Deep Learning Method.

Classification of battery laser welding defects via enhanced image preprocessing methods and explainable artificial intelligence-based verification

Enhancing Weld Inspection Through Comparative Analysis of Traditional Algorithms and Deep Learning Approaches

On-line Defect Recognition of MIG Lap Welding for Stainless Steel Sheet Based on Weld Image and CMT Voltage: Feature Fusion and Attention Weights Visualization

Deep convolutional neural network for weld defect classification in radiographic images

An Autonomous Technique for Multi Class Weld Imperfections Detection and Classification by Support Vector Machine

A Weld Surface Defect Recognition Method Based on Improved MobileNetV2 Algorithm

Classification of Weld Defect Based on Information Fusion Technology for Radiographic Testing System.