Abstract:Fourier transform profilometry (FTP) is a classic three-dimensional (3D) shape measurement technique that can retrieve the wrapped phase from a single fringe pattern. However, suffering from the spectral leakage and overlapping problems, it generally yields a coarse phase map with low spatial resolution and precision. Recently, deep learning has been introduced to the field of Fringe projection profilometry (FPP), revealing promising results in fringe analysis, phase unwrapping, depth constraint and system calibration. However, for absolute shape measurement of general objects, the inherent depth ambiguity problem of a single fringe is still insurmountable. In this work, we propose a composite deep learning framework for absolute 3D shape measurement based on single fringe phase retrieval and speckle correlation. Our method combines the advantages of FPP techniques for high-resolution phase retrieval and speckle correlation approaches for robust unambiguous depth measurement. The proposed deep learning framework comprises two paths: one is a U-net-structured network, which is used to extract the wrapped phase maps from a single fringe pattern with high accuracy (but with depth ambiguities). The other stereo matching network produces the initial absolute (but with low resolution) disparity map from an additional speckle pattern. The initial disparity map is refined by exploiting the wrapped phase maps as an additional constraint and finally, a high-accuracy high-resolution disparity map for absolute 3D measurement can be obtained. Experimental results demonstrated that the proposed deep-learning-based method could realize high-precision absolute 3D measurement with an accuracy of 50 mu m for measuring objects with complex surfaces.

Adaptive Depth Measurement Based on Adversarial Relevance Vector Regression for Fringe Projection Profilometry

Adaptive Depth Measurement with Defocus Blurred Structured Light Based on Adversarial Relevance Vector Regression

Real-time Motion-Induced Error Reduction for Phase-Shifting Profilometry with Projection Points Tracking Method

Surface Measurement Methods Based on Single and Multi-Frequency Fringes and Its Applications in Reverse Engineering

Stereo Vision and Fourier Transform Profilometry for 3D Measurement

Large Depth-of-field Fringe Projection Profilometry Applied to Defocused Scenes

Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

Composite Deep Learning Framework for Absolute 3D Shape Measurement Based on Single Fringe Phase Retrieval and Speckle Correlation

An adaptive fringe projection method for 3D measurement with high-reflective surfaces

Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement

Deep Learning-Based 3D Measurements with Near-Infrared Fringe Projection

Single-shot fringe projection profilometry based on Deep Learning and Computer Graphics

High-speed Real-Time 3D Shape Measurement Based on Adaptive Depth Constraint.

Weakly Supervised Depth Estimation for 3D Imaging with Single Camera Fringe Projection Profilometry

Weakly supervised phase unwrapping for single-camera fringe projection profilometry

Dynamic Projection Theory for Fringe Projection Profilometry.

3D shape measurement method for multi-reflective scenes based on accurate pixel-by-pixel phase-error adjustment strategy

Deep Learning-enabled Spatial Phase Unwrapping for 3D Measurement

Deep learning based measurement accuracy improvement of high dynamic range objects in fringe projection profilometry

Scene-adaptive pattern coding-based fringe projection profilometry: diffuse surfaces identification and 3-D reconstruction in cluttered scenes