Abstract:The inspection of welding surface quality is an important task for welding work. With the development of product quality inspection technology, automated and machine vision-based inspection have been applied to more industrial application fields because of its non-contact, convenience, and high efficiency. However, challenging material and optical phenomena such as high reflective surface areas often present on welding seams tend to produce artifacts such as holes in the reconstructed model using current visual sensors, hence leading to insufficiency or even errors in the inspection result. This paper presents a 3D reconstruction technique for highly reflective welding surfaces based on binocular style structured light stereo vision. The method starts from capturing a fully lit image for identifying highly reflective regions on a welding surface using conventional computer vision models, including gray-scale, binarization, dilation, and erosion. Then, fringe projection profilometry is used to generate point clouds on the interested area. The mapping and alignment from 2D image to 3D point cloud is then established to highlight features that are vital for eliminating “holes”—large featureless areas—caused by high reflections such as the specular mirroring effect. A two-way slicing method is proposed to operate on the refined point cloud, following the concept of dimensionality reduction to project the sliced point cloud onto different image planes before a Smoothing Spline model is applied to fit the discrete point formed by projection. The 3D coordinate values of points in the “hole” region are estimated according to the fitted curves and appended to the original point cloud using iterative algorithms. Experiment results verify that the proposed method can accurately reconstruct a wide range of welding surfaces with significantly improved precision.

Lambertian Reflection Separation under High Reflectiveness for Worn Surface Reconstruction with Insufficient Samples.

A Non-Lambertian Photometric Stereo under Perspective Projection

Numerical Reflectance Compensation for Non-Lambertian Photometric Stereo

In-situ 3D reconstruction of worn surface topography via optimized photometric stereo

Toward a General Model for Reflection Recovery and Single Image Enhancement.

Improved Reflectance Reconstruction for Multispectral Imaging by Combining Different Techniques.

A Novel Learning Based Non-Lambertian Photometric Stereo Method for Pixel-Level Normal Reconstruction of Polished Surfaces

Non-Lambertian Photometric Stereo Vision Based On Inverse Reflectance Model

3D Reconstruction of High Reflective Welding Surface Based on Binocular Structured Light Stereo Vision

Three-dimensional Reconstruction of Wear Particle Surface Based on Photometric Stereo

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Prior-shape-guided Photometric Stereo Model for 3D Damage Measurement of Worn Surfaceiks

Non-Lambertian photometric stereo by color and noise analysis

Topology Reconstruction of High-Reflective Surfaces Based on Multi-modality Data

Wear Depth Estimation from Single 2-D Image Based on Shape from Shading and Convolutional Neural Network Hybrid Model for In-Situ Wear Assessment

Fusing Multiview and Photometric Stereo for 3D Reconstruction under Uncalibrated Illumination

Profile Measurement of Non-Lambertian Surfaces by Integrating Fringe Projection Profilometry with Near-Field Photometric Stereo

Efficient Blind Separation Of Reflection Layers With Nonparametric Transformations

Robust Geometry and Reflectance Disentanglement for 3D Face Reconstruction from Sparse-view Images

Multi-view photometric stereo of non-Lambertian surface under general illuminations