Abstract:Fourier ptychographic microscopy (FPM) is a newly developed microscopic technique for large field of view, high-resolution and quantitative phase imaging by combining the techniques from ptychographic imaging, aperture synthesizing and phase retrieval. In FPM, an LED array is utilized to illuminate the specimen from different angles and the corresponding intensity images are synthesized to reconstruct a high-resolution complex field. As a flexible and low-cost approach to achieve high-resolution, wide-field and quantitative phase imaging, FPM is of enormous potential in biomedical applications such as hematology and pathology. Conventionally, the FPM reconstruction problem is solved by using a phase retrieval method, termed Alternate Projection. By iteratively updating the Fourier spectrum with low-resolution-intensity images, the result converges to a high-resolution complex field. Here we propose a new FPM reconstruction framework with deep learning methods and design a multiscale, deep residual neural network for FPM reconstruction. We employ the widely used open-source deep learning library PyTorch to train and test our model and carefully choose the hyperparameters of our model. To train and analyze our model, we build a large-scale simulation dataset with an FPM imaging model and an actual dataset captured with an FPM system. The simulation dataset and actual dataset are separated as training datasets and test datasets, respectively. Our model is trained with the simulation training dataset and fine tuned with the fine-tune dataset, which contains actual training data. Both our model and the conventional method are tested on the simulation test dataset and the actual test dataset to evaluate the performances. We also show the reconstruction result of another neural network-based method for comparison. The experiments demonstrate that our model achieves better reconstruction results and consumes much less time than conventional methods. The results also point out that our model is more robust under system aberrations such as noise and blurring (fewer intensity images) compared with conventional methods.

The Integration of Neural Network and Physical Reconstruction Model for Fourier Ptychographic Microscopy

Forward Imaging Neural Network with Correction of Positional Misalignment for Fourier Ptychographic Microscopy.

Aberration Correction Method For Fourier Ptychographic Microscopy Based On Neural Network

Effect of spatial spectrum overlap on fourier ptychographic microscopy

Fourier Ptychographic Microscopy Reconstruction with Multiscale Deep Residual Network.

Fourier ptychography multi-parameter neural network with composite physical priori optimization

PgNN: Physics-guided Neural Network for Fourier Ptychographic Microscopy

Fourier Ptychographic Microscopy Reconstruction Based on Deep Learning

Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction

Physics‐based Learning with Channel Attention for Fourier Ptychographic Microscopy

Adaptive coded illumination Fourier ptychography microscopy based on physical neural network

A Positional Misalignment Correction Method for Fourier Ptychographic Microscopy Based on the Quasi-Newton Method with a Global Optimization Module

Fourier Ptychographic Microscopy Reconstruction Method Based on Residual Local Mixture Network

Unsupervised Adaptive Coded Illumination Fourier Ptychographic Microscopy Based on a Physical Neural Network

Batch-FPM: Random batch-update multi-parameter physical Fourier ptychography neural network

Transformer-Based Reconstruction for Fourier Ptychographic Microscopy

Fourier Ptychography with Information Entropy Based No-Reference Image Quality Assessment Learning

Fourier Ptychographic Microscopic Reconstruction Method Based on Residual Hybrid Attention Network

Neural Network Model Assisted Fourier Ptychography with Zernike Aberration Recovery and Total Variation Constraint

Multiplex Fourier ptychographic reconstruction with model-based neural network for Internet of Things

A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions