Abstract:Recently, deep learning has yielded transformative success across optics and photonics, especially in optical metrology.Deep neural networks (DNNs) with a fully convolutional architecture (e.g., U-Net and its derivatives) have been widely implemented in an end-to-end manner to accomplish various optical metrology tasks, such as fringe denoising, phase unwrapping, and fringe analysis.However, the task of training a DNN to accurately identify an image-to-image transform from massive input and output data pairs seems at best naïve, as the physical laws governing the image formation or other domain expertise pertaining to the measurement have not yet been fully exploited in current deep learning practice.To this end, we introduce a physics-informed deep learning method for fringe pattern analysis (PI-FPA) to overcome this limit by integrating a lightweight DNN with a learning-enhanced Fourier transform profilometry (LeFTP) module.By parameterizing conventional phase retrieval methods, the LeFTP module embeds the prior knowledge in the network structure and the loss function to directly provide reliable phase results for new types of samples, while circumventing the requirement of collecting a large amount of high-quality data in supervised learning methods.Guided by the initial phase from LeFTP, the phase recovery ability of the lightweight DNN is enhanced to further improve the phase accuracy at a low computational cost compared with existing end-to-end networks.Experimental results demonstrate that PI-FPA enables more accurate and computationally efficient single-shot phase retrieval, exhibiting its excellent generalization to various unseen objects during training.The proposed PI-FPA presents that challenging issues in optical metrology can be potentially overcome through the synergy of physics-priors-based traditional tools and data-driven learning approaches, opening new avenues to achieve fast and accurate single-shot 3D imaging.

Single frame phase retrieval with a deep learning method

Single-frame Noisy Interferogram Phase Retrieval Using an End-to-end Deep Learning Network with Physical Information Constraints

End-to-end Single-Shot Composite Fringe Projection Profilometry Based on Deep Learning

Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning

Enhanced fringe-to-phase framework using deep learning

Single-shot Phase Extraction for Fringe Projection Profilometry Using Deep Convolutional Generative Adversarial Network

Single-shot Spatial Frequency Multiplex Fringe Pattern for Phase Unwrapping Using Deep Learning

Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement

Generalized framework for non-sinusoidal fringe analysis using deep learning

Physics-informed Deep Learning for Fringe Pattern Analysis

Composite Deep Learning Framework for Absolute 3D Shape Measurement Based on Single Fringe Phase Retrieval and Speckle Correlation

Fringe Pattern Analysis Using Deep Learning

Deep-learning-enabled Dual-Frequency Composite Fringe Projection Profilometry for Single-Shot Absolute 3D Shape Measurement

Single-shot 3D shape measurement with spatial frequency multiplexing using deep learning

Deep Learning-Enabled Single-Shot Fringe Projection Profilometry with Composite Coding Strategy

Learning-based absolute 3D shape measurement based on single fringe phase retrieval and speckle correlation

Weakly supervised phase unwrapping for single-camera fringe projection profilometry

Deep Learning-Based 3D Measurements with Near-Infrared Fringe Projection

Deep Learning-Based Single-Shot Spatial Frequency Multiplexing Composite Fringe Projection Profilometry

Phase Retrieval from a Single Diffraction Intensity Pattern by Generating the Support Constraint Using Deep Learning

A Spatial Phase Unwrapping Approach for Single-frame 3D Shape Measurement Based on Deep Learning