Abstract:Speckle projection profilometry (SPP), which establishes the global correspondences between stereo images by projecting only a single speckle pattern, has the advantage of single-shot 3D reconstruction. Nevertheless, SPP suffers from the low matching accuracy of traditional stereo matching algorithms, which fundamentally limits its 3D measurement accuracy. In this work, we propose a single-shot 3D shape measurement method using an end-to-end stereo matching network for SPP. To build a high-quality SPP dataset for training the network, by combining phase-shifting profilometry (PSP) and temporal phase unwrapping techniques, high-precision absolute phase maps can be obtained to generate accurate and dense disparity maps with high completeness as the ground truth by phase matching. For the architecture of the network, a multi-scale residual subnetwork is first leveraged to synchronously extract compact feature tensors with 1/4 resolution from speckle images for constructing the 4D cost volume. Considering that the cost filtering based on 3D convolution is computationally costly, a lightweight 3D U-net network is proposed to implement efficient 4D cost aggregation. In addition, because the disparity maps in the SPP dataset should have valid values only in the foreground, a simple and fast saliency detection network is integrated to avoid predicting the invalid pixels in the occlusions and background regions, thereby implicitly enhancing the matching accuracy for valid pixels. Experiment results demonstrated that the proposed method improves the matching accuracy by about 50% significantly compared with traditional stereo matching methods. Consequently, our method achieves fast and absolute 3D shape measurement with an accuracy of about 100µm through a single speckle pattern.

Error suppression for speckle correlation-based 3D shape measurement via dynamic shape function selection

Real-time Motion-Induced Error Reduction for Phase-Shifting Profilometry with Projection Points Tracking Method

Phase Error Correction by &Lt;inline-Formula><math Display="inline" Overflow="scroll"><mi>π</mi></math></inline-Formula>-shift Odd-Step Fringe Projection and Speckle Filtering in Phase Measuring Profilometry

High-Quality 3d Shape Measurement By Kernel-Optimized High Sinusoidal Similarity Dither Patterns

Study of the performance of different subpixel image correlation methods in 3D digital image correlation.

Errors Caused by Misalignment of the Optical Camera Axis and the Object Surface in the DSCM

High-Dynamic-Range 3-D Shape Measurement With Adaptive Speckle Projection Through Segmentation-Based Mapping

Single-shot 3D Shape Measurement Using an End-to-end Stereo Matching Network for Speckle Projection Profilometry.

Progress in Digital Image Correlation Method

Impact of Speckle Deformability on Digital Imaging Correlation

A digital speckle stereo matching algorithm based on epipolar line correction

On errors of digital image correlation due to speckle patterns

Three-dimensional shape and deformation measurement on complex structure parts

Spatial Uncertainty of Measurement Errors in Digital Image Correlation

High-Accuracy Three-Dimensional Deformation Measurement System Based on Fringe Projection and Speckle Correlation

Quality assessment of speckle patterns for DIC by consideration of both systematic errors and random errors

Study on subset size selection in digital image correlation for speckle patterns.

Precise 3D shape measurement of three-dimensional digital image correlation for complex surfaces

High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system

An Accurate Method for Shape Retrieval and Displacement Measurement Using Bi-Prism-Based Single Lens 3D Digital Image Correlation

Curved Surface Fitting Method of Sub-Pixel Small Angle Measurement