Abstract:This paper proposes a ptychographic phase‐retrieval algorithm combined with a deep neural network (DNN). The proposed method allows the measurement model to be explicitly incorporated into the DNN‐based approach, improving imaging capability and robustness to changes in experimental conditions.Ptychography is a powerful computational imaging technique with microscopic imaging capability and adaptability to various specimens. To obtain an imaging result, it requires a phase‐retrieval algorithm whose performance directly determines the imaging quality. Recently, deep neural network (DNN)‐based phase retrieval has been proposed to improve the imaging quality from the ordinary model‐based iterative algorithms. However, the DNN‐based methods have some limitations because of the sensitivity to changes in experimental conditions and the difficulty of collecting enough measured specimen images for training the DNN. To overcome these limitations, a ptychographic phase‐retrieval algorithm that combines model‐based and DNN‐based approaches is proposed. This method exploits a DNN‐based denoiser to assist an iterative algorithm like ePIE in finding better reconstruction images. This combination of DNN and iterative algorithms allows the measurement model to be explicitly incorporated into the DNN‐based approach, improving its robustness to changes in experimental conditions. Furthermore, to circumvent the difficulty of collecting the training data, it is proposed that the DNN‐based denoiser be trained without using actual measured specimen images but using a formula‐driven supervised approach that systemically generates synthetic images. In experiments using simulation based on a hard X‐ray ptychographic measurement system, the imaging capability of the proposed method was evaluated by comparing it with ePIE and rPIE. These results demonstrated that the proposed method was able to reconstruct higher‐spatial‐resolution images with half the number of iterations required by ePIE and rPIE, even for data with low illumination intensity. Also, the proposed method was shown to be robust to its hyperparameters. In addition, the proposed method was applied to ptychographic datasets of a Simens star chart and ink toner particles measured at SPring‐8 BL24XU, which confirmed that it can successfully reconstruct images from measurement scans with a lower overlap ratio of the illumination regions than is required by ePIE and rPIE.

Accurate phase retrieval of complex point spread functions with deep residual neural networks

Application of Vector Phase Retrieval Model in High Numerical Aperture Optical Systems

Optimal Phase Mask Design for Coherent Modulation Imaging by Deep Learning

Single-frame Noisy Interferogram Phase Retrieval Using an End-to-end Deep Learning Network with Physical Information Constraints

Optimized Phase Retrieval Method Based on Multi-Focus Property of Zone Plate

Direct retrieval of Zernike-based pupil functions using integrated diffractive deep neural networks

Using Diffraction Deep Neural Networks for Indirect Phase Recovery Based on Zernike Polynomials

Simultaneous Reconstruction of Phase and Amplitude for Wavefront Measurements Based on Nonlinear Optimization Algorithms

Physics-based Iterative Projection Complex Neural Network for Phase Retrieval in Lensless Microscopy Imaging

Real-time phase-retrieval and wavefront sensing enabled by an artificial neural network

3D-2D Neural Nets for Phase Retrieval in Noisy Interferometric Imaging

Coordinate-based Neural Network for Fourier Phase Retrieval

Physics-enhanced Neural Network for Phase Retrieval from Two Diffraction Patterns

Phase Retrieval Via Nonlocal Complex-Domain Sparsity.

Quantitative Pure-Phase Object Reconstruction under Single-Shot Fourier Measurement Via Deep Learning

Ptychographic phase retrieval via a deep‐learning‐assisted iterative algorithm

Complex imaging of phase domains by deep neural networks

Recognizing three-dimensional phase images with deep learning

End-to-end Direct Phase Retrieval from a Single-Frame Interferogram Based on Deep Learning

A Phase Retrieval Algorithm for Complex Optical Field

Untrained Single Scanning Phase Retrieval Neural Network for Surface Deformation Measurement of Large-Aperture Antennas