Abstract:Fourier ptychographic microscopy (FPM) is a newly developed microscopic technique for large field of view, high-resolution and quantitative phase imaging by combining the techniques from ptychographic imaging, aperture synthesizing and phase retrieval. In FPM, an LED array is utilized to illuminate the specimen from different angles and the corresponding intensity images are synthesized to reconstruct a high-resolution complex field. As a flexible and low-cost approach to achieve high-resolution, wide-field and quantitative phase imaging, FPM is of enormous potential in biomedical applications such as hematology and pathology. Conventionally, the FPM reconstruction problem is solved by using a phase retrieval method, termed Alternate Projection. By iteratively updating the Fourier spectrum with low-resolution-intensity images, the result converges to a high-resolution complex field. Here we propose a new FPM reconstruction framework with deep learning methods and design a multiscale, deep residual neural network for FPM reconstruction. We employ the widely used open-source deep learning library PyTorch to train and test our model and carefully choose the hyperparameters of our model. To train and analyze our model, we build a large-scale simulation dataset with an FPM imaging model and an actual dataset captured with an FPM system. The simulation dataset and actual dataset are separated as training datasets and test datasets, respectively. Our model is trained with the simulation training dataset and fine tuned with the fine-tune dataset, which contains actual training data. Both our model and the conventional method are tested on the simulation test dataset and the actual test dataset to evaluate the performances. We also show the reconstruction result of another neural network-based method for comparison. The experiments demonstrate that our model achieves better reconstruction results and consumes much less time than conventional methods. The results also point out that our model is more robust under system aberrations such as noise and blurring (fewer intensity images) compared with conventional methods.

Neural Network Model Assisted Fourier Ptychography with Zernike Aberration Recovery and Total Variation Constraint

Aberration Correction Method For Fourier Ptychographic Microscopy Based On Neural Network

Forward Imaging Neural Network with Correction of Positional Misalignment for Fourier Ptychographic Microscopy.

The Integration of Neural Network and Physical Reconstruction Model for Fourier Ptychographic Microscopy

PgNN: Physics-guided Neural Network for Fourier Ptychographic Microscopy

Neural Network Model with Positional Deviation Correction for Fourier Ptychography

Fourier Ptychographic Neural Network Combined with Zernike Aberration Recovery and Wirtinger Flow Optimization

Improving the resolution of Fourier ptychographic imaging using an a<i> priori</i> neural network

Improving the resolution of Fourier ptychographic imaging using a priori neural network

Fourier Ptychography Based on Deep Learning

Fourier Ptychographic Microscopy Reconstruction with Multiscale Deep Residual Network.

Physics‐based Learning with Channel Attention for Fourier Ptychographic Microscopy

Fourier Ptychographic Microscopy Reconstruction Based on Deep Learning

Solving Fourier ptychographic imaging problems via neural network modeling and TensorFlow

Fourier Ptychographic Microscopy Reconstruction Method Based on Residual Transfer Networks

Fourier ptychography multi-parameter neural network with composite physical priori optimization

Full-field Fourier Ptychography (FFP): Spatially Varying Pupil Modeling and Its Application for Rapid Field-Dependent Aberration Metrology

Correction Algorithms of Pupil Aberration for Fourier Ptychographic Microscopy

u-net CNN based fourier ptychography

Parameterized Reconstruction Based Fourier Ptychography

Fourier Ptychography with Information Entropy Based No-Reference Image Quality Assessment Learning