Abstract:Speckle projection profilometry (SPP), which establishes the global correspondences between stereo images by projecting only a single speckle pattern, has the advantage of single-shot 3D reconstruction. Nevertheless, SPP suffers from the low matching accuracy of traditional stereo matching algorithms, which fundamentally limits its 3D measurement accuracy. In this work, we propose a single-shot 3D shape measurement method using an end-to-end stereo matching network for SPP. To build a high-quality SPP dataset for training the network, by combining phase-shifting profilometry (PSP) and temporal phase unwrapping techniques, high-precision absolute phase maps can be obtained to generate accurate and dense disparity maps with high completeness as the ground truth by phase matching. For the architecture of the network, a multi-scale residual subnetwork is first leveraged to synchronously extract compact feature tensors with 1/4 resolution from speckle images for constructing the 4D cost volume. Considering that the cost filtering based on 3D convolution is computationally costly, a lightweight 3D U-net network is proposed to implement efficient 4D cost aggregation. In addition, because the disparity maps in the SPP dataset should have valid values only in the foreground, a simple and fast saliency detection network is integrated to avoid predicting the invalid pixels in the occlusions and background regions, thereby implicitly enhancing the matching accuracy for valid pixels. Experiment results demonstrated that the proposed method improves the matching accuracy by about 50% significantly compared with traditional stereo matching methods. Consequently, our method achieves fast and absolute 3D shape measurement with an accuracy of about 100µm through a single speckle pattern.

Improved speckle projection profilometry for out-of-plane shape measurement.

Real-time Motion-Induced Error Reduction for Phase-Shifting Profilometry with Projection Points Tracking Method

3D Measurement System Based on Computer-Generated Gratings

Phase Error Correction by &Lt;inline-Formula><math Display="inline" Overflow="scroll"><mi>π</mi></math></inline-Formula>-shift Odd-Step Fringe Projection and Speckle Filtering in Phase Measuring Profilometry

Three-Dimensional Shape and Deformation Measurements Based on Fringe Projection Profilometry and Fluorescent Digital Image Correlation via a 3 Charge Coupled Device Camera

Accurate and Dynamic 3D Shape Measurement with Digital Image Correlation-Assisted Phase Shifting

High-Accuracy Three-Dimensional Deformation Measurement System Based on Fringe Projection and Speckle Correlation

Real-Time One-Point Out-Of-Plane Displacement Measurement System Using Electronic Speckle Pattern Interferometry

Full Area Covered 3D Profile Measurement of Special-Shaped Optics Based on a New Prototype Non-Contact Profiler.

Accurate 3-D Shape Measurement for Large Objects Using Speckle-Assisted Fringe Projection and Global Markers Localization.

Application of iteration and finite element smoothing technique for displacement and strain measurement of digital speckle correlation

High Speed Deformation Measurement Using Digital Speckle Correlation Method

3D Deformation Measurement by Digital Speckle Correlation Method and Stereo Vision

Chromatic DIC-Assisted Fringe Projection Profilometry for Shape, Deformation, and Strain Measurement With Intensity-Chroma Space Analysis

High-Dynamic-Range 3-D Shape Measurement With Adaptive Speckle Projection Through Segmentation-Based Mapping

Single-shot 3D Shape Measurement Using an End-to-end Stereo Matching Network for Speckle Projection Profilometry.

Three 1-bit Speckle-embedded pulse-width modulation patterns for robust absolute 3D measurement

Speckle Projection Profilometry with Deep Learning

A digital speckle stereo matching algorithm based on epipolar line correction

A speckle projection-based 3D digital image correlation method for measuring dynamic liquid surfaces

3d Deformation Measurement By Digital Speckle Correlation Method And Stereo Vision - Art. No. 67231n