Abstract:Recently, deep learning has yielded transformative success across optics and photonics, especially in optical metrology.Deep neural networks (DNNs) with a fully convolutional architecture (e.g., U-Net and its derivatives) have been widely implemented in an end-to-end manner to accomplish various optical metrology tasks, such as fringe denoising, phase unwrapping, and fringe analysis.However, the task of training a DNN to accurately identify an image-to-image transform from massive input and output data pairs seems at best naïve, as the physical laws governing the image formation or other domain expertise pertaining to the measurement have not yet been fully exploited in current deep learning practice.To this end, we introduce a physics-informed deep learning method for fringe pattern analysis (PI-FPA) to overcome this limit by integrating a lightweight DNN with a learning-enhanced Fourier transform profilometry (LeFTP) module.By parameterizing conventional phase retrieval methods, the LeFTP module embeds the prior knowledge in the network structure and the loss function to directly provide reliable phase results for new types of samples, while circumventing the requirement of collecting a large amount of high-quality data in supervised learning methods.Guided by the initial phase from LeFTP, the phase recovery ability of the lightweight DNN is enhanced to further improve the phase accuracy at a low computational cost compared with existing end-to-end networks.Experimental results demonstrate that PI-FPA enables more accurate and computationally efficient single-shot phase retrieval, exhibiting its excellent generalization to various unseen objects during training.The proposed PI-FPA presents that challenging issues in optical metrology can be potentially overcome through the synergy of physics-priors-based traditional tools and data-driven learning approaches, opening new avenues to achieve fast and accurate single-shot 3D imaging.

Near-infrared Fringe Projection Profilometry Based on Deep Learning

Deep Learning-Based 3D Measurements with Near-Infrared Fringe Projection

Automatic Phase Recognition Method Based on Convolutional Neural Network

Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning

Single-frame Noisy Interferogram Phase Retrieval Using an End-to-end Deep Learning Network with Physical Information Constraints

End-to-end Single-Shot Composite Fringe Projection Profilometry Based on Deep Learning

Generalized framework for non-sinusoidal fringe analysis using deep learning

Deep-learning-enabled Dual-Frequency Composite Fringe Projection Profilometry for Single-Shot Absolute 3D Shape Measurement

Fringe Pattern Analysis Using Deep Learning

Single-shot Phase Extraction for Fringe Projection Profilometry Using Deep Convolutional Generative Adversarial Network

Physics-informed Deep Learning for Fringe Pattern Analysis

Deep Learning-Enabled Anti-Ambient Light Approach for Fringe Projection Profilometry.

Color Deep Learning Profilometry for Single-Shot 3D Shape Measurement

Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement

Composite Deep Learning Framework for Absolute 3D Shape Measurement Based on Single Fringe Phase Retrieval and Speckle Correlation

High-speed 3D shape measurement from noisy fringe images using deep learning

Structured-light 3D Shape Measurements Using Deep Learning

Deep Learning-Enabled Single-Shot Fringe Projection Profilometry with Composite Coding Strategy

Pixel-Wise Phase Unwrapping of Fringe Projection Profilometry Based on Deep Learning

Deep Learning-Based Single-Shot Spatial Frequency Multiplexing Composite Fringe Projection Profilometry

Learning-based absolute 3D shape measurement based on single fringe phase retrieval and speckle correlation