Abstract:Artificial intelligence algorithms that aid mini-microscope imaging are attractive for numerous applications. In this paper, we optimize artificial intelligence techniques to provide clear, and natural biomedical imaging. We demonstrate that a deep learning-enabled super-resolution method can significantly enhance the spatial resolution of mini-microscopy and regular-microscopy. This data-driven approach trains a generative adversarial network to transform low-resolution images into super-resolved ones. Mini-microscopic images and regular-microscopic images acquired with different optical microscopes under various magnifications are collected as our experimental benchmark datasets. The only input to this generative-adversarial-network-based method are images from the datasets down-sampled by the Bicubic interpolation. We use independent test set to evaluate this deep learning approach with other deep learning-based algorithms through qualitative and quantitative comparisons. To clearly present the improvements achieved by this generative-adversarial-network-based method, we zoom into the local features to explore and highlight the qualitative differences. We also employ the peak signal-to-noise ratio and the structural similarity, to quantitatively compare alternative super-resolution methods. The quantitative results illustrate that super-resolution images obtained from our approach with interpolation parameter α=0.25 more closely match those of the original high-resolution images than to those obtained by any of the alternative state-of-the-art method. These results are significant for fields that use microscopy tools, such as biomedical imaging of engineered living systems. We also utilize this generative adversarial network-based algorithm to optimize the resolution of biomedical specimen images and then generate three-dimensional reconstruction, so as to enhance the ability of three-dimensional imaging throughout the entire volumes for spatial-temporal analyses of specimen structures.

Deep-learning-augmented Microscopy for Super-Resolution Imaging of Nanoparticles.

Applications of Nanostructures in Wide-Field, Label-Free Super Resolution Microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Super-Resolution Imaging of Sub-diffraction-Limited Pattern with Superlens Based on Deep Learning

High Resolution of Plasmonic Resonance Scattering Imaging with Deep Learning

Deep Learning Super-Resolution Electron Microscopy Based on Deep Residual Attention Network

Advances in Deep Learning for Super-Resolution Microscopy(Invited)

Real-Time Resolution Enhancement of Confocal Laser Scanning Microscopy via Deep Learning

Deep Learning-Enabled Resolution-Enhancement in Mini- and Regular Microscopy for Biomedical Imaging

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Deep Learning Microscopy

Far-Field Super-Resolution Imaging Using Near-Field Illumination by Micro-Fiber

Enhanced Nanoparticle Recognition via Deep Learning-Accelerated Plasmonic Sensing

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Super-resolution Microscopy by Grating and Deep Neural Network

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Far-Field Super-Resolution Optical Microscopy for Nanostructures in a Reflective Substrate