Abstract:At present, sensor recognition technology has become a research hotspot in welding process monitoring. However, most of the existing defect recognition methods are based on single-sensor information, which hinders the further improvement of recognition accuracy and weakens the anti-interference ability under complex conditions. To overcome the shortcomings of single-sensor recognition technology, multi-source information fusion technology can exploit the advantages of different types of sensors to achieve more comprehensive and accurate monitoring of the welding process. However, given the process of fusion of different information, the feature mining mechanism of the deep learning model is still under-explained, and the direct complementarity of the different information remains unclear. In this paper, we propose a hybrid model that uses the fusion of molten pool image and voltage signals to quickly and accurately identify three types of defects in lap MIG welding: burn -through, weld bias, and uneven width. Firstly, a synchronized trigger device is used to acquire molten pool images and weld voltage information, and the voltage data is sliced and matched with the molten pool image data. Secondly, the Short-Time Fourier Transform (STFT) is applied to explore the frequency variation components in the voltage data, and the resulting time-frequency matrix is transformed into a time spectrogram. Finally, the molten pool image and the time spectrogram are simultaneously fed into the hybrid CNN model for online monitoring of welding defect states. The test results show that the average accuracy of the hybrid CNN model in detecting five different welding states reaches 98.87 %, which is significantly higher than three other models based on single sensor information. The visualization of the confusion matrix and Grad-CAM shows that the hybrid CNN model based on multi-source heterogeneous information has a higher accuracy for detecting the transition states that are difficult to detect in welding, and has a more reasonable mechanism for allocating attention, so it can achieve a more accurate and balanced recognition effect in the whole welding manufacturing process. These studies can provide guidance for quality monitoring of welding processes based on multi-source sensor technology, which can be extended to the field of arc additive monitoring.

Identification of weld defect through the application of denoising method to the sound signal acquired during pulse mode laser welding

Adaptive Wavelet Thresholding Based Ultrasonic Signal Denoising

Welding Penetration Monitoring for Ship Robotic GMAW Using Arc Sound Sensing Based on Improved Wavelet Denoising

Defect detection during laser welding using electrical signals and high-speed photography

Frequency Selection for On-line Identification of Welding Penetration Through Audible Sound

Data-driven analysis of surface roughness influence on weld quality and defect formation in laser welding of Cu–Al

A Water Environment-Based Simulated Method for Ultrasonic Testing of Slag Inclusion Weld Defects Based on Improved VMD

Finite element simulation of laser-generated ultrasonic waves for quantitative detection of internal defects in welds

Titanium Alloy Weld Time-of-Flight Diffraction Image Denoising Based on a Wavelet Feature Fusion Deep-Learning Model

Real-time Seam Penetration Identification in Arc Welding Based on Fusion of Sound, Voltage and Spectrum Signals

Dynamic Welding Process Monitoring Based on Microphone Array Technology

Weld Penetration Identification with Deep Learning Method Based on Auditory Spectrum Images of Arc Sounds

Quantitative Detection of Laser Welding Defective Structure Based on Feature Exaction of the Pulsed Eddy Current Signal

A Spectroscopic Method Based on Support Vector Machine and Artificial Neural Network for Fiber Laser Welding Defects Detection and Classification

Use of a structure-borne sound-based in-process sensor system to identify Weld seam irregularities during electron beam welding

Quality classification model with machine learning for porosity prediction in laser welding aluminum alloys

Classification of weld quality in ultrasonic composite welding using vibration information

Feature Extraction in Welding Penetration Monitoring with Arc Sound Signals

Mechanism Analysis and Feature Extraction of Arc Sound Channel for Pulse GTAW Welding Dynamic Process

On-line Defect Recognition of MIG Lap Welding for Stainless Steel Sheet Based on Weld Image and CMT Voltage: Feature Fusion and Attention Weights Visualization

Resistance spot welding defect detection based on vectorized dynamic resistance signal and LightGBM Classifier