Abstract:This paper proposes a ptychographic phase‐retrieval algorithm combined with a deep neural network (DNN). The proposed method allows the measurement model to be explicitly incorporated into the DNN‐based approach, improving imaging capability and robustness to changes in experimental conditions.Ptychography is a powerful computational imaging technique with microscopic imaging capability and adaptability to various specimens. To obtain an imaging result, it requires a phase‐retrieval algorithm whose performance directly determines the imaging quality. Recently, deep neural network (DNN)‐based phase retrieval has been proposed to improve the imaging quality from the ordinary model‐based iterative algorithms. However, the DNN‐based methods have some limitations because of the sensitivity to changes in experimental conditions and the difficulty of collecting enough measured specimen images for training the DNN. To overcome these limitations, a ptychographic phase‐retrieval algorithm that combines model‐based and DNN‐based approaches is proposed. This method exploits a DNN‐based denoiser to assist an iterative algorithm like ePIE in finding better reconstruction images. This combination of DNN and iterative algorithms allows the measurement model to be explicitly incorporated into the DNN‐based approach, improving its robustness to changes in experimental conditions. Furthermore, to circumvent the difficulty of collecting the training data, it is proposed that the DNN‐based denoiser be trained without using actual measured specimen images but using a formula‐driven supervised approach that systemically generates synthetic images. In experiments using simulation based on a hard X‐ray ptychographic measurement system, the imaging capability of the proposed method was evaluated by comparing it with ePIE and rPIE. These results demonstrated that the proposed method was able to reconstruct higher‐spatial‐resolution images with half the number of iterations required by ePIE and rPIE, even for data with low illumination intensity. Also, the proposed method was shown to be robust to its hyperparameters. In addition, the proposed method was applied to ptychographic datasets of a Simens star chart and ink toner particles measured at SPring‐8 BL24XU, which confirmed that it can successfully reconstruct images from measurement scans with a lower overlap ratio of the illumination regions than is required by ePIE and rPIE.

One-shot Phase Retrieval Method for Interferometry Using a Hypercolumns Convolutional Neural Network

Single-frame Noisy Interferogram Phase Retrieval Using an End-to-end Deep Learning Network with Physical Information Constraints

Automatic Phase Recognition Method Based on Convolutional Neural Network

Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning

Using Diffraction Deep Neural Networks for Indirect Phase Recovery Based on Zernike Polynomials

Single-shot Phase Extraction for Fringe Projection Profilometry Using Deep Convolutional Generative Adversarial Network

Generalized framework for non-sinusoidal fringe analysis using deep learning

Quantitative Pure-Phase Object Reconstruction under Single-Shot Fourier Measurement Via Deep Learning

Hilbert transformation deep learning network for single-shot moiré profilometry

3D-2D Neural Nets for Phase Retrieval in Noisy Interferometric Imaging

Ptychographic phase retrieval via a deep‐learning‐assisted iterative algorithm

A Single-Shot Phase Retrieval Method for Phase Measuring Deflectometry Based on Deep Learning

Physics-based Iterative Projection Complex Neural Network for Phase Retrieval in Lensless Microscopy Imaging

Phase Retrieval from a Single Diffraction Intensity Pattern by Generating the Support Constraint Using Deep Learning

Single‐Shot Recognition of 3D Phase Images with Deep Learning

End-to-end Single-Shot Composite Fringe Projection Profilometry Based on Deep Learning

Single-frame interferogram phase retrieval using a phase-shifting generative adversarial network with physics-based fine-tuning

Recognizing three-dimensional phase images with deep learning

Two-frame advanced iterative self-tuning algorithm for accurate phase retrieval

Learning-based absolute 3D shape measurement based on single fringe phase retrieval and speckle correlation

Deep Learning-Based Interference Fringes Detection Using Convolutional Neural Network