Abstract:The inspection of welding surface quality is an important task for welding work. With the development of product quality inspection technology, automated and machine vision-based inspection have been applied to more industrial application fields because of its non-contact, convenience, and high efficiency. However, challenging material and optical phenomena such as high reflective surface areas often present on welding seams tend to produce artifacts such as holes in the reconstructed model using current visual sensors, hence leading to insufficiency or even errors in the inspection result. This paper presents a 3D reconstruction technique for highly reflective welding surfaces based on binocular style structured light stereo vision. The method starts from capturing a fully lit image for identifying highly reflective regions on a welding surface using conventional computer vision models, including gray-scale, binarization, dilation, and erosion. Then, fringe projection profilometry is used to generate point clouds on the interested area. The mapping and alignment from 2D image to 3D point cloud is then established to highlight features that are vital for eliminating “holes”—large featureless areas—caused by high reflections such as the specular mirroring effect. A two-way slicing method is proposed to operate on the refined point cloud, following the concept of dimensionality reduction to project the sliced point cloud onto different image planes before a Smoothing Spline model is applied to fit the discrete point formed by projection. The 3D coordinate values of points in the “hole” region are estimated according to the fitted curves and appended to the original point cloud using iterative algorithms. Experiment results verify that the proposed method can accurately reconstruct a wide range of welding surfaces with significantly improved precision.

Method for Locating Top Workpieces Based on Monocular Stereo Vision

Stereo Vision Based SLAM in Outdoor Environments

Recognition and Distance Estimation of an Irregular Object in Package Sorting Line Based on Monocular Vision

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Workpiece Intelligent Identification and Positioning System based on Binocular Machine Vision

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Object segmentation using stereo images

A Multi-View Stereo Measurement System Based on a Laser Scanner for Fine Workpieces

3d Stereoscopic Image Generation From Monocular View In Structured Environments

High-precision target positioning system for unmanned vehicles based on binocular vision

Robot Target Location Based on the Difference in Monocular Vision Projection

In-situ 3D reconstruction of worn surface topography via optimized photometric stereo

Three-dimensional reconstruction of mobile binocular stereo vision based on push-broom line structured light for a workpiece surface

Accurate spray paint design of reciprocating machine based on binocular stereo vision

Recognizing and Locating a Known Object from Multiple Images

Multilevel Feature Detection Algorithm Based on Bifocal Monocular Stereo Vision

3D Reconstruction of High Reflective Welding Surface Based on Binocular Structured Light Stereo Vision

A Precise Survey Method for Objects at a Distance Based on Stereo Panorama

Binocular stereovision omnidirectional motion handling robot

Graph-based Stereo Matching by Incorporating Monocular Cues

Dynamic Workpiece Modeling with Robotic Pick-Place Based on Stereo Vision Scanning Using Fast Point-Feature Histogram Algorithm