Abstract:Speckle projection profilometry (SPP), which establishes the global correspondences between stereo images by projecting only a single speckle pattern, has the advantage of single-shot 3D reconstruction. Nevertheless, SPP suffers from the low matching accuracy of traditional stereo matching algorithms, which fundamentally limits its 3D measurement accuracy. In this work, we propose a single-shot 3D shape measurement method using an end-to-end stereo matching network for SPP. To build a high-quality SPP dataset for training the network, by combining phase-shifting profilometry (PSP) and temporal phase unwrapping techniques, high-precision absolute phase maps can be obtained to generate accurate and dense disparity maps with high completeness as the ground truth by phase matching. For the architecture of the network, a multi-scale residual subnetwork is first leveraged to synchronously extract compact feature tensors with 1/4 resolution from speckle images for constructing the 4D cost volume. Considering that the cost filtering based on 3D convolution is computationally costly, a lightweight 3D U-net network is proposed to implement efficient 4D cost aggregation. In addition, because the disparity maps in the SPP dataset should have valid values only in the foreground, a simple and fast saliency detection network is integrated to avoid predicting the invalid pixels in the occlusions and background regions, thereby implicitly enhancing the matching accuracy for valid pixels. Experiment results demonstrated that the proposed method improves the matching accuracy by about 50% significantly compared with traditional stereo matching methods. Consequently, our method achieves fast and absolute 3D shape measurement with an accuracy of about 100µm through a single speckle pattern.

High-speed 3D Face Measurement Based on Color Speckle Projection

Rapid 3d Reconstruction Based on Color Fringe Projection

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

3D Measurement System Based on Computer-Generated Gratings

Multi-objects Real Time Recognition Based on Color Information

Stereo Vision and Fourier Transform Profilometry for 3D Measurement

Data Processing Method of Time-of-flight 3D Imaging Camera

High-Dynamic-Range 3-D Shape Measurement With Adaptive Speckle Projection Through Segmentation-Based Mapping

Rapid 3D measurement of colour objects based on three-channel sinusoidal fringe projection

High dynamic range 3D measurements based on space-time speckle correlation and color camera

Single-shot 3D Shape Measurement Using an End-to-end Stereo Matching Network for Speckle Projection Profilometry.

Accurate 3D reconstruction of single-frame speckle-encoded textureless surfaces based on densely connected stereo matching network

Robust 3D Face Recognition by Local Shape Difference Boosting

High-Accuracy Three-Dimensional Deformation Measurement System Based on Fringe Projection and Speckle Correlation

High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system

3D SPECTRUM IMAGING AND COMPUTER RECONSTRUCTION SYSTEM

Efficient Active Depth Sensing by Laser Speckle Projection System

A fast three-dimensional measurement method based on color fringe projection and background intensity calibration

[Calamitous moments: rethinking the ethics of post disaster psychological reconstruction programs].

3D Face Reconstruction Using Color Photometric Stereo with Uncalibrated Near Point Lights

High-precision 3D shape measurement based on time-resolved VCSEL