Abstract:Fourier ptychographic microscopy (FPM) is a newly developed microscopic technique for large field of view, high-resolution and quantitative phase imaging by combining the techniques from ptychographic imaging, aperture synthesizing and phase retrieval. In FPM, an LED array is utilized to illuminate the specimen from different angles and the corresponding intensity images are synthesized to reconstruct a high-resolution complex field. As a flexible and low-cost approach to achieve high-resolution, wide-field and quantitative phase imaging, FPM is of enormous potential in biomedical applications such as hematology and pathology. Conventionally, the FPM reconstruction problem is solved by using a phase retrieval method, termed Alternate Projection. By iteratively updating the Fourier spectrum with low-resolution-intensity images, the result converges to a high-resolution complex field. Here we propose a new FPM reconstruction framework with deep learning methods and design a multiscale, deep residual neural network for FPM reconstruction. We employ the widely used open-source deep learning library PyTorch to train and test our model and carefully choose the hyperparameters of our model. To train and analyze our model, we build a large-scale simulation dataset with an FPM imaging model and an actual dataset captured with an FPM system. The simulation dataset and actual dataset are separated as training datasets and test datasets, respectively. Our model is trained with the simulation training dataset and fine tuned with the fine-tune dataset, which contains actual training data. Both our model and the conventional method are tested on the simulation test dataset and the actual test dataset to evaluate the performances. We also show the reconstruction result of another neural network-based method for comparison. The experiments demonstrate that our model achieves better reconstruction results and consumes much less time than conventional methods. The results also point out that our model is more robust under system aberrations such as noise and blurring (fewer intensity images) compared with conventional methods.

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Alternative deep learning method for fast spatial-frequency shift imaging microscopy.

Adaptive Optics For Structured Illumination Microscopy Based On Deep Learning

Deep learning based wavefront sensor for complex wavefront detection in adaptive optical microscopes.

Deep Tissue Focusing Based on Machine Learning

Machine learning guided rapid focusing with sensor-less aberration corrections.

Simplifying the detection of optical distortions by machine learning

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Deep Learning-Assisted Wavefront Correction with Sparse Data for Holographic Tomography

Deep learning-driven adaptive optics for single-molecule localization microscopy

Real-Time Resolution Enhancement of Confocal Laser Scanning Microscopy via Deep Learning

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Reconstructing 3D Biomedical Architectural Order at Multiple Spatial Scales with Multimodal Stack Input

Fourier Ptychographic Microscopy Reconstruction with Multiscale Deep Residual Network.

Optical Aberration Correction via Phase Diversity and Deep Learning

Super-Resolution Image Reconstruction of Wavefront Coding Imaging System Based on Deep Learning Network

Deep Learning Microscopy

Simulation-driven Learning: a Deep Learning Approach for Image Scanning Microscopy Via Physical Imaging Models

Deep Learning Enables Confocal Laser-Scanning Microscopy with Enhanced Resolution

DeepLeMiN: Deep-learning-empowered Physics-aware Lensless Miniscope