Abstract:Robotic welding technology is constantly growing with the development of vision technologies. To establish a fully automatic robotic welding system, an automated weld seam extraction process with accurate perception of the target workpiece (i.e., object) is one of the most challenging tasks. Although many methods pertaining to automatic weld seam extraction have been proposed, most of the previous studies are difficult to employ in practical systems because the algorithms are unable to simultaneously handle multiple and occluded seams from arbitrary view directions. In this study, we propose a novel method to extract weld seams based on point cloud registration from various view directions that can handle randomly occluded seams in a workpiece with multiple seam parts. We focus on the shape of the weld seams as a line or curve, which are dominant structures in the field. Initially, we extract all detectable weld seams for each image with a single view direction obtained using an RGB-depth vision sensor. Subsequently, three-dimensional points of weld seams obtained from each view direction are filtered based on the edge cues from RGB images. Finally, the extracted weld seams obtained from the various view directions are merged by employing a point cloud registration technique. The experimental results demonstrate that the proposed method outperforms a state-of-the-art method in terms of detection accuracy. Our proposed algorithm can be employed for dynamic workpiece scenes, which indicates that multiple weld seams can be successfully extracted from arbitrary view directions containing scene occlusions.

3D vision-based weld seam extraction method

A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments

A 3D seam extraction and tracking method based on binocular structured light sensor

A Novel 3D Seam Extraction Method Based on Multi-Functional Sensor for V-Type Weld Seam

A Method of D-Type Weld Seam Extraction Based on Point Clouds

A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot

A Vision Based Detection Method For Narrow Butt Joints And A Robotic Seam Tracking System

Vision Sensing and Surface Fitting for Real-Time Detection of Tight Butt Joints

A Novel 3-D Path Extraction Method for Arc Welding Robot Based on Stereo Structured Light Sensor

Automatic 3D Seam Extraction Method for Welding Robot Based on Monocular Structured Light

A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision

Online Extraction of Pose Information of 3D Zigzag-Line Welding Seams for Welding Seam Tracking

Autonomous weld seam identification and localisation using eye-in-hand stereo vision for robotic arc welding

A vision-based method for narrow weld trajectory recognition of arc welding robots

Coarse-to-Fine Detection of Multiple Seams for Robotic Welding

Research on Welding Guidance System of Intelligent Perception for Steel Weldment

A novel method for dense point cloud reconstruction and weld seam detection for tubesheet welding robot

Automatic Identification of Multi-Type Weld Seam Based on Vision Sensor With Silhouette-Mapping

Multiple weld seam extraction from RGB-depth images for automatic robotic welding via point cloud registration

The 3D narrow butt weld seam detection system based on the binocular consistency correction

A Novel 3D Complex Welding Seam Tracking Method in Symmetrical Robotic MAG Welding Process Using a Laser Vision Sensing