Abstract:Recently, deep learning has yielded transformative success across optics and photonics, especially in optical metrology.Deep neural networks (DNNs) with a fully convolutional architecture (e.g., U-Net and its derivatives) have been widely implemented in an end-to-end manner to accomplish various optical metrology tasks, such as fringe denoising, phase unwrapping, and fringe analysis.However, the task of training a DNN to accurately identify an image-to-image transform from massive input and output data pairs seems at best naïve, as the physical laws governing the image formation or other domain expertise pertaining to the measurement have not yet been fully exploited in current deep learning practice.To this end, we introduce a physics-informed deep learning method for fringe pattern analysis (PI-FPA) to overcome this limit by integrating a lightweight DNN with a learning-enhanced Fourier transform profilometry (LeFTP) module.By parameterizing conventional phase retrieval methods, the LeFTP module embeds the prior knowledge in the network structure and the loss function to directly provide reliable phase results for new types of samples, while circumventing the requirement of collecting a large amount of high-quality data in supervised learning methods.Guided by the initial phase from LeFTP, the phase recovery ability of the lightweight DNN is enhanced to further improve the phase accuracy at a low computational cost compared with existing end-to-end networks.Experimental results demonstrate that PI-FPA enables more accurate and computationally efficient single-shot phase retrieval, exhibiting its excellent generalization to various unseen objects during training.The proposed PI-FPA presents that challenging issues in optical metrology can be potentially overcome through the synergy of physics-priors-based traditional tools and data-driven learning approaches, opening new avenues to achieve fast and accurate single-shot 3D imaging.

Artificial intelligence and Fourier optics: Application of DeepLabV3+ in the recovery of a diffracting aperture in light propagation

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Deep Non-line-of-sight Imaging from Under-scanning Measurements.

Deep learning-based deconvolution for interferometric radio transient reconstruction

DNF: Diffractive Neural Field for Lensless Microscopic Imaging

Adaptive optics with reflected light and deep neural networks

Deep Learning for Design and Retrieval of Nano-photonic Structures

Physics-informed Deep Learning for Fringe Pattern Analysis

Long-Range Imaging through Scattering Media Using Deep Learning

RestoreNet: a deep learning framework for image restoration in optical synthetic aperture imaging system

Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imaging

Deep-learning Projector for Optical Diffraction Tomography.

Deep Neural Networks for Computational Optical Form Measurements

Correction of Refractive Index Mismatch-Induced Aberrations under Radially Polarized Illumination by Deep Learning.

Towards smart optical focusing: Deep learning-empowered wavefront shaping in nonstationary scattering media

Ultracompact Deep Neural Network for Ultrafast Optical Property Extraction in Spatial Frequency Domain Imaging (SFDI)

Deep Learning VLBI Image Reconstruction with Closure Invariants

AF-AMPNet: A Deep Learning Approach for Sparse Aperture ISAR Imaging and Autofocusing.

Deep Learning-Based 3D Measurements with Near-Infrared Fringe Projection

Deep learning in optical metrology: a review

A New Deep Learning Method for Image Deblurring in Optical Microscopic Systems