Abstract:At present, sensor recognition technology has become a research hotspot in welding process monitoring. However, most of the existing defect recognition methods are based on single-sensor information, which hinders the further improvement of recognition accuracy and weakens the anti-interference ability under complex conditions. To overcome the shortcomings of single-sensor recognition technology, multi-source information fusion technology can exploit the advantages of different types of sensors to achieve more comprehensive and accurate monitoring of the welding process. However, given the process of fusion of different information, the feature mining mechanism of the deep learning model is still under-explained, and the direct complementarity of the different information remains unclear. In this paper, we propose a hybrid model that uses the fusion of molten pool image and voltage signals to quickly and accurately identify three types of defects in lap MIG welding: burn -through, weld bias, and uneven width. Firstly, a synchronized trigger device is used to acquire molten pool images and weld voltage information, and the voltage data is sliced and matched with the molten pool image data. Secondly, the Short-Time Fourier Transform (STFT) is applied to explore the frequency variation components in the voltage data, and the resulting time-frequency matrix is transformed into a time spectrogram. Finally, the molten pool image and the time spectrogram are simultaneously fed into the hybrid CNN model for online monitoring of welding defect states. The test results show that the average accuracy of the hybrid CNN model in detecting five different welding states reaches 98.87 %, which is significantly higher than three other models based on single sensor information. The visualization of the confusion matrix and Grad-CAM shows that the hybrid CNN model based on multi-source heterogeneous information has a higher accuracy for detecting the transition states that are difficult to detect in welding, and has a more reasonable mechanism for allocating attention, so it can achieve a more accurate and balanced recognition effect in the whole welding manufacturing process. These studies can provide guidance for quality monitoring of welding processes based on multi-source sensor technology, which can be extended to the field of arc additive monitoring.

Classification of weld quality in ultrasonic composite welding using vibration information

Online Quality Inspection of Ultrasonic Composite Welding by Combining Artificial Intelligence Technologies with Welding Process Signatures

Welding Quality Monitoring of High Frequency Straight Seam Pipe Based on Image Feature

Quality detection and classification for ultrasonic welding of carbon fiber composites using time-series data and neural network methods

Real-Time Quality Monitoring of Ultrathin Sheets Edge Welding Based on Microvision Sensing and SOCIFS-SVM.

Classification of Weld Defect Based on Information Fusion Technology for Radiographic Testing System.

Multisensor-Based Real-Time Quality Monitoring by Means of Feature Extraction, Selection and Modeling for Al Alloy in Arc Welding

Ultrasonic Weld Quality Inspection Involving Strength Prediction and Defect Detection in Data-Constrained Training Environments

An Effective Method of Weld Defect Detection and Classification Based on Machine Vision

A Spectroscopic Method Based on Support Vector Machine and Artificial Neural Network for Fiber Laser Welding Defects Detection and Classification

The Use of Thermal Data for Quality Assurance in the Process of Continuous Ultrasonic Welding of Thermoplastic Composite Materials

Automated Classification of Ultrasonic Signal via a Convolutional Neural Network

EMD-based Pulsed TIG Welding Process Porosity Defect Detection and Defect Diagnosis Using GA-SVM

Online prediction of mechanical and electrical quality in ultrasonic metal welding using time series generation and deep learning

Classification of spot-welded joint strength using ultrasonic signal time-frequency features and PSO-SVM method

Real-time Seam Penetration Identification in Arc Welding Based on Fusion of Sound, Voltage and Spectrum Signals

Research on weld seam feature extraction and defect identification technology

Simulation of Temperature and Weld Growth Mechanism in Ultrasonic Welding of Carbon Fiber Reinforced Polyamide 66 Composite: Employing the High Frequency Real-Time Horn Vibration

The Intelligent Methodology for Monitoring the Dynamic Welding Quality Using Visual and Audio Sensor

On-line Defect Recognition of MIG Lap Welding for Stainless Steel Sheet Based on Weld Image and CMT Voltage: Feature Fusion and Attention Weights Visualization

Weld defect classification using 1-D LBP feature extraction of ultrasonic signals