Abstract:The inspection of welding surface quality is an important task for welding work. With the development of product quality inspection technology, automated and machine vision-based inspection have been applied to more industrial application fields because of its non-contact, convenience, and high efficiency. However, challenging material and optical phenomena such as high reflective surface areas often present on welding seams tend to produce artifacts such as holes in the reconstructed model using current visual sensors, hence leading to insufficiency or even errors in the inspection result. This paper presents a 3D reconstruction technique for highly reflective welding surfaces based on binocular style structured light stereo vision. The method starts from capturing a fully lit image for identifying highly reflective regions on a welding surface using conventional computer vision models, including gray-scale, binarization, dilation, and erosion. Then, fringe projection profilometry is used to generate point clouds on the interested area. The mapping and alignment from 2D image to 3D point cloud is then established to highlight features that are vital for eliminating “holes”—large featureless areas—caused by high reflections such as the specular mirroring effect. A two-way slicing method is proposed to operate on the refined point cloud, following the concept of dimensionality reduction to project the sliced point cloud onto different image planes before a Smoothing Spline model is applied to fit the discrete point formed by projection. The 3D coordinate values of points in the “hole” region are estimated according to the fitted curves and appended to the original point cloud using iterative algorithms. Experiment results verify that the proposed method can accurately reconstruct a wide range of welding surfaces with significantly improved precision.

Three-dimensional Reconstruction of Wear Particle Surface Based on Photometric Stereo

In-situ 3D reconstruction of worn surface topography via optimized photometric stereo

Three-dimensional Shape Measurement of Particles Contamination in Lubricant Based on Rotational Stereoscopic Vision

A Novel SFP Extracting/Tracking Framework for Rigid Microstructure Measurement

Stereo Vision and Fourier Transform Profilometry for 3D Measurement

Contactless 3D Fingerprint Identification Without 3D Reconstruction.

The Application of 3D Surface Metrology in Characterization of Femoral Stem Wear

Research on Analysis Technology of Ferrograph Image

Combining Photogrammetry and Photometric Stereo to Achieve Precise and Complete 3D Reconstruction

Semantic Segmentation of Ferrography Images for Automatic Wear Particle Analysis

3D Reconstruction of High Reflective Welding Surface Based on Binocular Structured Light Stereo Vision

A Robust 3-D Abrasion Diagnosis Method of Pantograph Slipper Based on Stereo Vision

Automatic 3D Reconstruction of SEM Images Based on Nano-robotic Manipulation and Epipolar Plane Images.

Research on micro/nano scale 3D reconstruction based on scanning electron microscope

3D Microstructure Reconstruction and Characterization of Porous Materials Using a Cross-Sectional SEM Image and Deep Learning

3D nanostructure reconstruction based on the SEM imaging principle, and applications.

Wear particles image enhancement using long short-term memory 3D recurrent reconstruction neural network (LSTM 3D-R2N2)

New Challenges in Tribology: Wear Assessment Using 3D Optical Scanners

Robotic measurement system based on cooperative optical profiler integrating fringe projection with photometric stereo for highly reflective workpiece

3-D optical microscopy with a new synthetic SFF algorithm to reconstruct surfaces with various specular and diffusive reflectance

Application of computer image processing technology in oilfield underground mining machinery