Abstract:The inspection of welding surface quality is an important task for welding work. With the development of product quality inspection technology, automated and machine vision-based inspection have been applied to more industrial application fields because of its non-contact, convenience, and high efficiency. However, challenging material and optical phenomena such as high reflective surface areas often present on welding seams tend to produce artifacts such as holes in the reconstructed model using current visual sensors, hence leading to insufficiency or even errors in the inspection result. This paper presents a 3D reconstruction technique for highly reflective welding surfaces based on binocular style structured light stereo vision. The method starts from capturing a fully lit image for identifying highly reflective regions on a welding surface using conventional computer vision models, including gray-scale, binarization, dilation, and erosion. Then, fringe projection profilometry is used to generate point clouds on the interested area. The mapping and alignment from 2D image to 3D point cloud is then established to highlight features that are vital for eliminating “holes”—large featureless areas—caused by high reflections such as the specular mirroring effect. A two-way slicing method is proposed to operate on the refined point cloud, following the concept of dimensionality reduction to project the sliced point cloud onto different image planes before a Smoothing Spline model is applied to fit the discrete point formed by projection. The 3D coordinate values of points in the “hole” region are estimated according to the fitted curves and appended to the original point cloud using iterative algorithms. Experiment results verify that the proposed method can accurately reconstruct a wide range of welding surfaces with significantly improved precision.

Multi-vision Based 3D Reconstruction System for Robotic Grinding

Kinect V2 Camera Based Vision System for Robotic Grinding.

Visual Odometry Based 3D-Reconstruction

Vision-guided path planning and joint configuration optimization for robot grinding of spatial surface weld beads via point cloud

Point cloud 3D parent surface reconstruction and weld seam feature extraction for robotic grinding path planning

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

A novel path planning method of robotic grinding for free-form weld seam based on 3D point cloud

3D curvature grinding path planning based on point cloud data

A Vision-Based Processing Methodology for Profile Grinding of Contour Surfaces

Feature extraction and robot path planning method in 3D vision-guided welding for multi-blade wheel structures

A vision-based calibration method for aero-engine blade-robotic grinding system

Multi-robot autonomous 3D reconstruction using Gaussian splatting with Semantic guidance

On-Line 3D Reconstruction Based on Laser Scanning for Robot Machining of Large Complex Components

Vision System of Mobile Robot Combining Binocular and Depth Cameras

Methodology and Implementation of a Vision-Oriented Open CNC System for Profile Grinding

Online Process Monitoring Based on Vibration-Surface Quality Map for Robotic Grinding

3D Reconstruction of High Reflective Welding Surface Based on Binocular Structured Light Stereo Vision

High-precision Occlusion-Resistant Quad-Vision Camera 3D Reconstruction System

High-accuracy Real-Time Omnidirectional 3D Scanning and Inspection System

A novel feature-guided trajectory generation method based on point cloud for robotic grinding of freeform welds