Abstract:The real-time recognition of weld feature locations in compounded noises is very critical when it comes to robotic weld tracking and intelligent welding. Due to strong noise interference, it is arduous for traditional machine vision to obtain satisfactory detection results. Traditional deep convolution networks carry a huge number of parameters including slow detection speed, and low detection accuracy, which cannot be reached the actual welding requirements. Therefore, this paper proposed a new lightweight detector called Light-YOLO-Welding based on an improved YOLOv4 for detecting weld feature points. Firstly, modification of the backbone network is done to be MobileNetv3, which decreases the network parameters and increases the detection speed. Secondly, the replacement of the path aggregation network is done with Bidirectional Feature Pyramid Network (BiFPN) based on the idea of bidirectional cross-scale connection that integrates richer semantic features and maintains spatial information, applying depthwise separable convolutions in SPP and BiFPN layers. Lastly, to solve the problem of imbalanced positive and negative samples in the assembled data, a class loss function based on AP-Loss is proposed to improve weld feature recognition accuracy. The results show that the mAP of this method is 98.84%, the accuracy is 98.08%, the recall is 97.87%, and the speed is 62.22f/s; the results further confirmed that the method has higher accuracy and speed. The average error of the camera coordinate system key weld points extraction is 0.102 mm. Compared with other methods, the proposed method is more reliable and efficient for detecting weld feature points.

A novel method for dense point cloud reconstruction and weld seam detection for tubesheet welding robot

A Method of D-Type Weld Seam Extraction Based on Point Clouds

A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments

WeldNet: A voxel-based deep learning network for point cloud annular weld seam detection

Point Cloud 3D Weldment Reconstruction and Welding Feature Extraction for Robotic Multi-bead Arc Weld Cladding Path Plaanning

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot

3D vision-based weld seam extraction method

Multilayer positioning strategy for tubesheet welding robot based on point cloud model

A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision

Online Extraction of Pose Information of 3D Zigzag-Line Welding Seams for Welding Seam Tracking

A point cloud-based welding trajectory planning method for plane welds

Path Planning With Automatic Seam Extraction Over Point Cloud Models for Robotic Arc Welding

An Approach to the Extraction of Intersecting Pipes Weld Seam Based on 3D Point Cloud

Weld feature extraction method based on inter-frame constraint and dynamic template

A Novel 3-D Path Extraction Method for Arc Welding Robot Based on Stereo Structured Light Sensor

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

Research on Welding Guidance System of Intelligent Perception for Steel Weldment

A vision-based method for narrow weld trajectory recognition of arc welding robots

A Framework for Synchronous Extraction of Multi-Type Steel Mesh Features Based on Measured Point Clouds

A 3D seam extraction and tracking method based on binocular structured light sensor