Abstract:Artificial intelligence algorithms that aid mini-microscope imaging are attractive for numerous applications. In this paper, we optimize artificial intelligence techniques to provide clear, and natural biomedical imaging. We demonstrate that a deep learning-enabled super-resolution method can significantly enhance the spatial resolution of mini-microscopy and regular-microscopy. This data-driven approach trains a generative adversarial network to transform low-resolution images into super-resolved ones. Mini-microscopic images and regular-microscopic images acquired with different optical microscopes under various magnifications are collected as our experimental benchmark datasets. The only input to this generative-adversarial-network-based method are images from the datasets down-sampled by the Bicubic interpolation. We use independent test set to evaluate this deep learning approach with other deep learning-based algorithms through qualitative and quantitative comparisons. To clearly present the improvements achieved by this generative-adversarial-network-based method, we zoom into the local features to explore and highlight the qualitative differences. We also employ the peak signal-to-noise ratio and the structural similarity, to quantitatively compare alternative super-resolution methods. The quantitative results illustrate that super-resolution images obtained from our approach with interpolation parameter α=0.25 more closely match those of the original high-resolution images than to those obtained by any of the alternative state-of-the-art method. These results are significant for fields that use microscopy tools, such as biomedical imaging of engineered living systems. We also utilize this generative adversarial network-based algorithm to optimize the resolution of biomedical specimen images and then generate three-dimensional reconstruction, so as to enhance the ability of three-dimensional imaging throughout the entire volumes for spatial-temporal analyses of specimen structures.

Super-Resolution and Large Depth of Field Model for Optical Microscope Imaging

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Large-scale microscope with improved resolution using SRGAN

Deep Learning-Enabled Resolution-Enhancement in Mini- and Regular Microscopy for Biomedical Imaging

Deep Learning Microscopy

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

High-Throughput Deep Learning Microscopy Using Multi-Angle Super-Resolution

DEEP NEURAL NETWORKS FOR IMAGE SUPER-RESOLUTION IN OPTICAL MICROSCOPY BY USING MODIFIED HYBRID TASK CASCADE U-NET

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Deep Learning Super-Resolution Electron Microscopy Based on Deep Residual Attention Network

A New Deep Learning Method for Image Deblurring in Optical Microscopic Systems

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Large Depth-of-field Computational Imaging with Multi-Spectral and Dual-Aperture Optics.

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Endoscopic Image Deblurring and Super-Resolution Reconstruction Based on Deep Learning

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model.

Real-Time Resolution Enhancement of Confocal Laser Scanning Microscopy via Deep Learning

Deep-learning-augmented Microscopy for Super-Resolution Imaging of Nanoparticles.