Abstract:Fourier transform profilometry (FTP) is a classic three-dimensional (3D) shape measurement technique that can retrieve the wrapped phase from a single fringe pattern. However, suffering from the spectral leakage and overlapping problems, it generally yields a coarse phase map with low spatial resolution and precision. Recently, deep learning has been introduced to the field of Fringe projection profilometry (FPP), revealing promising results in fringe analysis, phase unwrapping, depth constraint and system calibration. However, for absolute shape measurement of general objects, the inherent depth ambiguity problem of a single fringe is still insurmountable. In this work, we propose a composite deep learning framework for absolute 3D shape measurement based on single fringe phase retrieval and speckle correlation. Our method combines the advantages of FPP techniques for high-resolution phase retrieval and speckle correlation approaches for robust unambiguous depth measurement. The proposed deep learning framework comprises two paths: one is a U-net-structured network, which is used to extract the wrapped phase maps from a single fringe pattern with high accuracy (but with depth ambiguities). The other stereo matching network produces the initial absolute (but with low resolution) disparity map from an additional speckle pattern. The initial disparity map is refined by exploiting the wrapped phase maps as an additional constraint and finally, a high-accuracy high-resolution disparity map for absolute 3D measurement can be obtained. Experimental results demonstrated that the proposed deep-learning-based method could realize high-precision absolute 3D measurement with an accuracy of 50 mu m for measuring objects with complex surfaces.

Absolute Phase Retrieval for a Single-Shot Fringe Projection Profilometry Based on Deep Learning

End-to-end Single-Shot Composite Fringe Projection Profilometry Based on Deep Learning

Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning

Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement

Single frame phase retrieval with a deep learning method

End-to-end Deep Learning Method for Absolute Phase Retrieval

Deep Learning-based Single Frame Phase Retrieval

Untrained Deep Learning-Based Phase Retrieval for Fringe Projection Profilometry

Deep-learning-enabled Dual-Frequency Composite Fringe Projection Profilometry for Single-Shot Absolute 3D Shape Measurement

Near-infrared Fringe Projection Profilometry Based on Deep Learning

A Multi-Code 3D Measurement Technique Based on Deep Learning

Learning-based absolute 3D shape measurement based on single fringe phase retrieval and speckle correlation

Single-shot Spatial Frequency Multiplex Fringe Pattern for Phase Unwrapping Using Deep Learning

Composite Deep Learning Framework for Absolute 3D Shape Measurement Based on Single Fringe Phase Retrieval and Speckle Correlation

Absolute Phase Retrieval Using One Coded Pattern and Geometric Constraints of Fringe Projection System

Absolute Phase Recovery of Single Frame Composite Image Based on Convolutional Neural Network

Pixel-Wise Phase Unwrapping of Fringe Projection Profilometry Based on Deep Learning

Single-shot 3D shape measurement with spatial frequency multiplexing using deep learning

Coding-Net: A Multi-Purpose Neural Network for Fringe Projection Profilometry

A Spatial Phase Unwrapping Approach for Single-frame 3D Shape Measurement Based on Deep Learning

Single-Shot Multi-Frequency 3D Shape Measurement for Discontinuous Surface Object Based on Deep Learning