Abstract:Fourier transform profilometry (FTP) is a classic three-dimensional (3D) shape measurement technique that can retrieve the wrapped phase from a single fringe pattern. However, suffering from the spectral leakage and overlapping problems, it generally yields a coarse phase map with low spatial resolution and precision. Recently, deep learning has been introduced to the field of Fringe projection profilometry (FPP), revealing promising results in fringe analysis, phase unwrapping, depth constraint and system calibration. However, for absolute shape measurement of general objects, the inherent depth ambiguity problem of a single fringe is still insurmountable. In this work, we propose a composite deep learning framework for absolute 3D shape measurement based on single fringe phase retrieval and speckle correlation. Our method combines the advantages of FPP techniques for high-resolution phase retrieval and speckle correlation approaches for robust unambiguous depth measurement. The proposed deep learning framework comprises two paths: one is a U-net-structured network, which is used to extract the wrapped phase maps from a single fringe pattern with high accuracy (but with depth ambiguities). The other stereo matching network produces the initial absolute (but with low resolution) disparity map from an additional speckle pattern. The initial disparity map is refined by exploiting the wrapped phase maps as an additional constraint and finally, a high-accuracy high-resolution disparity map for absolute 3D measurement can be obtained. Experimental results demonstrated that the proposed deep-learning-based method could realize high-precision absolute 3D measurement with an accuracy of 50 mu m for measuring objects with complex surfaces.

Passive Binary Defocusing for Large Depth 3D Measurement Based on Deep Learning.

High-Quality Three-Dimensional Shape Measurement Based on Binary Particle Swarm Dithering Optimization

A depth measurement method using two structured light binary patterns

High-Quality 3d Shape Measurement By Kernel-Optimized High Sinusoidal Similarity Dither Patterns

Full-field Phase Error Analysis and Compensation for Nonsinusoidal Waveforms in Phase Shifting Profilometry with Projector Defocusing

Fast Three-Dimensional Profilometry with Large Depth of Field

Threshold-optimized Dithering Technique for High-quality 3D Shape Measurement

Phase error analysis and compensation for phase shifting profilometry with projector defocusing

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

High-frame Rate, Large-Depth-range Structured Light Projector Based on the Step-Designed LED Chips Array

A Novel Defocus-Degree-Based Phase Unwrapping and Fusion Algorithm for High-Speed and Large-Depth-Range 3D Measurement

Phase error compensation for three-dimensional shape measurement with projector defocusing

Real-Time Microscopic 3d Shape Measurement Based on Optimized Pulse-Width-Modulation Binary Fringe Projection

Optimized Pulse Width Modulation Pattern Strategy for Three-Dimensional Profilometry with Projector Defocusing.

Spatial–Temporal Binarization Method via Jointly Optimizing Diffusion Kernel and Quantization Threshold for 3-D Surface Imaging

Improved Dual-Frequency On-Line Phase Measuring Profilometry Based On Full-Cycle Equal Phase-Shift Algorithm

Accurate and Dynamic 3D Shape Measurement with Digital Image Correlation-Assisted Phase Shifting

Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning

Single-shot 3D shape measurement with spatial frequency multiplexing using deep learning

Composite Deep Learning Framework for Absolute 3D Shape Measurement Based on Single Fringe Phase Retrieval and Speckle Correlation

Deep-learning-enabled Dual-Frequency Composite Fringe Projection Profilometry for Single-Shot Absolute 3D Shape Measurement