Abstract:At present, sensor recognition technology has become a research hotspot in welding process monitoring. However, most of the existing defect recognition methods are based on single-sensor information, which hinders the further improvement of recognition accuracy and weakens the anti-interference ability under complex conditions. To overcome the shortcomings of single-sensor recognition technology, multi-source information fusion technology can exploit the advantages of different types of sensors to achieve more comprehensive and accurate monitoring of the welding process. However, given the process of fusion of different information, the feature mining mechanism of the deep learning model is still under-explained, and the direct complementarity of the different information remains unclear. In this paper, we propose a hybrid model that uses the fusion of molten pool image and voltage signals to quickly and accurately identify three types of defects in lap MIG welding: burn -through, weld bias, and uneven width. Firstly, a synchronized trigger device is used to acquire molten pool images and weld voltage information, and the voltage data is sliced and matched with the molten pool image data. Secondly, the Short-Time Fourier Transform (STFT) is applied to explore the frequency variation components in the voltage data, and the resulting time-frequency matrix is transformed into a time spectrogram. Finally, the molten pool image and the time spectrogram are simultaneously fed into the hybrid CNN model for online monitoring of welding defect states. The test results show that the average accuracy of the hybrid CNN model in detecting five different welding states reaches 98.87 %, which is significantly higher than three other models based on single sensor information. The visualization of the confusion matrix and Grad-CAM shows that the hybrid CNN model based on multi-source heterogeneous information has a higher accuracy for detecting the transition states that are difficult to detect in welding, and has a more reasonable mechanism for allocating attention, so it can achieve a more accurate and balanced recognition effect in the whole welding manufacturing process. These studies can provide guidance for quality monitoring of welding processes based on multi-source sensor technology, which can be extended to the field of arc additive monitoring.

Resistance spot welding defect detection based on vectorized dynamic resistance signal and LightGBM Classifier

Online Detection and Evaluation of Weld Surface Defects Based on Lightweight Network VGG16-UNet and Laser Scanning

Online detection of weld surface defects based on improved incremental learning approach

A Method for Detecting Micro-scale Weld Defects in Complex Background

EMD-based Pulsed TIG Welding Process Porosity Defect Detection and Defect Diagnosis Using GA-SVM

An Effective Method of Weld Defect Detection and Classification Based on Machine Vision

Detection and Strong Classification of Natural Weld Defects by Magneto-Optical Imaging Under Rotating Magnetic Field Excitation

Quality Evaluation of Resistance Spot Welding Based on Dynamic Reactance Signal and Radar Diagram Method

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

Quantitative Interpretation of Dynamic Resistance Signal in Resistance Spot Welding

A Spectroscopic Method Based on Support Vector Machine and Artificial Neural Network for Fiber Laser Welding Defects Detection and Classification

Deep learning assisted vision inspection of resistance spot welds

Robotic MAG Welding Defects and Quality Assessment with a Defect Threshold Decision Model-Driven Method

An Easy Method of Image Feature Extraction for Real-Time Welding Defects Detection

Weld defect classification using 1-D LBP feature extraction of ultrasonic signals

On-line Defect Recognition of MIG Lap Welding for Stainless Steel Sheet Based on Weld Image and CMT Voltage: Feature Fusion and Attention Weights Visualization

Defect detection method for high-resolution weld based on wandering Gaussian and multi-feature enhancement fusion

A weld seam feature real-time extraction method of three typical welds based on target detection

Dynamic Welding Process Monitoring Based on Microphone Array Technology

Weld Defect Detection Based on Deep Learning Method.

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment