Abstract:This paper proposes a ptychographic phase‐retrieval algorithm combined with a deep neural network (DNN). The proposed method allows the measurement model to be explicitly incorporated into the DNN‐based approach, improving imaging capability and robustness to changes in experimental conditions.Ptychography is a powerful computational imaging technique with microscopic imaging capability and adaptability to various specimens. To obtain an imaging result, it requires a phase‐retrieval algorithm whose performance directly determines the imaging quality. Recently, deep neural network (DNN)‐based phase retrieval has been proposed to improve the imaging quality from the ordinary model‐based iterative algorithms. However, the DNN‐based methods have some limitations because of the sensitivity to changes in experimental conditions and the difficulty of collecting enough measured specimen images for training the DNN. To overcome these limitations, a ptychographic phase‐retrieval algorithm that combines model‐based and DNN‐based approaches is proposed. This method exploits a DNN‐based denoiser to assist an iterative algorithm like ePIE in finding better reconstruction images. This combination of DNN and iterative algorithms allows the measurement model to be explicitly incorporated into the DNN‐based approach, improving its robustness to changes in experimental conditions. Furthermore, to circumvent the difficulty of collecting the training data, it is proposed that the DNN‐based denoiser be trained without using actual measured specimen images but using a formula‐driven supervised approach that systemically generates synthetic images. In experiments using simulation based on a hard X‐ray ptychographic measurement system, the imaging capability of the proposed method was evaluated by comparing it with ePIE and rPIE. These results demonstrated that the proposed method was able to reconstruct higher‐spatial‐resolution images with half the number of iterations required by ePIE and rPIE, even for data with low illumination intensity. Also, the proposed method was shown to be robust to its hyperparameters. In addition, the proposed method was applied to ptychographic datasets of a Simens star chart and ink toner particles measured at SPring‐8 BL24XU, which confirmed that it can successfully reconstruct images from measurement scans with a lower overlap ratio of the illumination regions than is required by ePIE and rPIE.

LoRePIE: $\ell_0$ Regularised Extended Ptychographical Iterative Engine for Low-dose and Fast Electron Ptychography

Deep Learning Colorful Ptychographic Iterative Engine Lens-Less Diffraction Microscopy

Effect of spatial spectrum overlap on fourier ptychographic microscopy

ELFPIE: an error-laxity Fourier ptychographic iterative engine

Large step size fly-scan ptychography using local sample separation reconstruction

Ptychographical iterative engine based on pixel binning for improving the computational efficiency

A parallel ptychographic iterative engine with a co-start region

Targeted-ROI imaging in electron paramagnetic resonance imaging.

Robust Ptychographic Reconstruction with an Out-of-Focus Electron Probe

Towards 3D Electron Ptychographic Reconstruction

Ptychographic phase retrieval via a deep‐learning‐assisted iterative algorithm

High-resolution terahertz ptychography using divergent illumination and extrapolation algorithm

An Efficient Electron Ptychography Method for Retrieving the Object Spectrum from Only a Few Iterations

PtychoFormer: A Transformer-based Model for Ptychographic Phase Retrieval

Live Iterative Ptychography

Physics-Informed Ellipsoidal Coordinate Encoding Implicit Neural Representation for high-resolution volumetric wide-field microscopy

Adaptive Step-Size Strategy for Noise-Robust Fourier Ptychographic Microscopy.

Optimization-based Image Reconstruction from Sparsely Sampled Data in Electron Paramagnetic Resonance Imaging.

A high-performance reconstruction method for partially coherent ptychography

Iterative Phase Retrieval Algorithms for Scanning Transmission Electron Microscopy

A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions