Abstract:The inspection of welding surface quality is an important task for welding work. With the development of product quality inspection technology, automated and machine vision-based inspection have been applied to more industrial application fields because of its non-contact, convenience, and high efficiency. However, challenging material and optical phenomena such as high reflective surface areas often present on welding seams tend to produce artifacts such as holes in the reconstructed model using current visual sensors, hence leading to insufficiency or even errors in the inspection result. This paper presents a 3D reconstruction technique for highly reflective welding surfaces based on binocular style structured light stereo vision. The method starts from capturing a fully lit image for identifying highly reflective regions on a welding surface using conventional computer vision models, including gray-scale, binarization, dilation, and erosion. Then, fringe projection profilometry is used to generate point clouds on the interested area. The mapping and alignment from 2D image to 3D point cloud is then established to highlight features that are vital for eliminating “holes”—large featureless areas—caused by high reflections such as the specular mirroring effect. A two-way slicing method is proposed to operate on the refined point cloud, following the concept of dimensionality reduction to project the sliced point cloud onto different image planes before a Smoothing Spline model is applied to fit the discrete point formed by projection. The 3D coordinate values of points in the “hole” region are estimated according to the fitted curves and appended to the original point cloud using iterative algorithms. Experiment results verify that the proposed method can accurately reconstruct a wide range of welding surfaces with significantly improved precision.

Online Detection Technique of 3D Defects for Steel Strips Based on Photometric Stereo

Depth extraction of 3D defects on curved surfaces with multi-line lasers

Outer surface defect detection of steel pipes with 3D vision based on multi-line structured lights

Automated Visual Defect Detection for Flat Steel Surface: A Survey

Online Aptitude Automatic Surface Quality Inspection System for Hot Rolled Strips Steel

Visual Detection of Surface Defects Based on Self-Feature Comparison in Robot 3-D Printing

Automated surface inspection for steel products using computer vision approach.

Fast Defect Inspection Based on Data-Driven Photometric Stereo.

Online Quality Monitoring in Material Extrusion Additive Manufacturing Processes Based on Laser Scanning Technology

A Structured Light Vision Sensor for Online Measurement of Steel-Plate Width

Research Progress of Automated Visual Surface Defect Detection for Industrial Metal Planar Materials

Steel Surface Defect Detection via Deformable Convolution and Background Suppression

Automated Surface Defect Detection for Cold-Rolled Steel Strip Based on Wavelet Anisotropic Diffusion Method

High-resolution Real-Time 360∘ 3D Surface Defect Inspection with Fringe Projection Profilometry

Fast 3D Surface Defect Detection with Fringe Projection

Automated Visual Defect Classification for Flat Steel Surface: A Survey

Development of an Optical Defect Inspection Algorithm Based on an Active Contour Model for Large Steel Roller Surfaces.

Steel Surface Defects Detection Based on Deep Learning

3D Reconstruction of High Reflective Welding Surface Based on Binocular Structured Light Stereo Vision

Key Technologies of Steel Plate Surface Defect Detection System Based on Artificial Intelligence Machine Vision

Multi-scale sensing and multi-dimensional feature enhancement for surface defect detection of hot-rolled steel strip