Abstract:The real-time recognition of weld feature locations in compounded noises is very critical when it comes to robotic weld tracking and intelligent welding. Due to strong noise interference, it is arduous for traditional machine vision to obtain satisfactory detection results. Traditional deep convolution networks carry a huge number of parameters including slow detection speed, and low detection accuracy, which cannot be reached the actual welding requirements. Therefore, this paper proposed a new lightweight detector called Light-YOLO-Welding based on an improved YOLOv4 for detecting weld feature points. Firstly, modification of the backbone network is done to be MobileNetv3, which decreases the network parameters and increases the detection speed. Secondly, the replacement of the path aggregation network is done with Bidirectional Feature Pyramid Network (BiFPN) based on the idea of bidirectional cross-scale connection that integrates richer semantic features and maintains spatial information, applying depthwise separable convolutions in SPP and BiFPN layers. Lastly, to solve the problem of imbalanced positive and negative samples in the assembled data, a class loss function based on AP-Loss is proposed to improve weld feature recognition accuracy. The results show that the mAP of this method is 98.84%, the accuracy is 98.08%, the recall is 97.87%, and the speed is 62.22f/s; the results further confirmed that the method has higher accuracy and speed. The average error of the camera coordinate system key weld points extraction is 0.102 mm. Compared with other methods, the proposed method is more reliable and efficient for detecting weld feature points.

Welding Splash and Arc Noise Reduction Imaging Model Based on Computationally Efficient Pairwise Response Serving Welding Process Library

Weld Seam Detection Method with Rotational Region Proposal Network.

Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

Acquisition of Weld Seam Dimensional Position Information for Arc Welding Robot Based on Vision Computing.

Research on the Model of Arc Noise in Welding Seam Tracking

Autonomous Detection of Weld Seam Profiles Via a Model of Saliency-Based Visual Attention for Robotic Arc Welding

Discerning Weld Seam Profiles from Strong Arc Background for the Robotic Automated Welding Process via Visual Attention Features

Plate additive, seam-tracking technology based on feature segmentation

Weld Seam Detection Based on Visual Saliency for Autonomous Welding Robots.

An Adaptive Feature Extraction Algorithm for Multiple Typical Seam Tracking Based on Vision Sensor in Robotic Arc Welding

Autonomous Seam Acquisition and Tracking for Robotic Welding Based on Passive Vision

Multiple weld seam laser vision recognition method based on the IPCE algorithm

Modeling Of Underwater Wet Welding Process Based On Visual And Arc Sensor

YOLO-Weld: A Modified YOLOv5-Based Weld Feature Detection Network for Extreme Weld Noise

A Novel Visual Image Sensor for CO2short Circuiting Arc Welding and Its Application in Weld Reinforcement Detection

A real-time seam tracking system based on extraction and restoration model in robotic GMAW

Robot Welding Seam Tracking Method Based on Passive Vision for Thin Plate Closed-Gap Butt Welding

Study on Visual Image Information Detection of External Angle Weld Based on Arc Welding Robot

Robust seam tracking via a deep learning framework combining tracking and detection

An automatic feature point extraction method based on laser vision for robotic multi-layer multi-pass weld seam tracking