Abstract:Artificial intelligence algorithms that aid mini-microscope imaging are attractive for numerous applications. In this paper, we optimize artificial intelligence techniques to provide clear, and natural biomedical imaging. We demonstrate that a deep learning-enabled super-resolution method can significantly enhance the spatial resolution of mini-microscopy and regular-microscopy. This data-driven approach trains a generative adversarial network to transform low-resolution images into super-resolved ones. Mini-microscopic images and regular-microscopic images acquired with different optical microscopes under various magnifications are collected as our experimental benchmark datasets. The only input to this generative-adversarial-network-based method are images from the datasets down-sampled by the Bicubic interpolation. We use independent test set to evaluate this deep learning approach with other deep learning-based algorithms through qualitative and quantitative comparisons. To clearly present the improvements achieved by this generative-adversarial-network-based method, we zoom into the local features to explore and highlight the qualitative differences. We also employ the peak signal-to-noise ratio and the structural similarity, to quantitatively compare alternative super-resolution methods. The quantitative results illustrate that super-resolution images obtained from our approach with interpolation parameter α=0.25 more closely match those of the original high-resolution images than to those obtained by any of the alternative state-of-the-art method. These results are significant for fields that use microscopy tools, such as biomedical imaging of engineered living systems. We also utilize this generative adversarial network-based algorithm to optimize the resolution of biomedical specimen images and then generate three-dimensional reconstruction, so as to enhance the ability of three-dimensional imaging throughout the entire volumes for spatial-temporal analyses of specimen structures.

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Superresolution reconstruction based on complementary composite structural illumination

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

A cascaded deep network for reconstruction of structured illumination microscopy

DEEP NEURAL NETWORKS FOR IMAGE SUPER-RESOLUTION IN OPTICAL MICROSCOPY BY USING MODIFIED HYBRID TASK CASCADE U-NET

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Time-lapse Image Super-resolution Neural Network with Reliable Confidence Quantification for Optical Microscopy

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes

Untrained Neural Network Enhances the Resolution of Structured Illumination Microscopy under Strong Background and Noise Levels

Time-lapse Image Super-resolution Neural Network with Reliable Confidence Evaluation for Optical Microscopy

Super-Resolution Structured Illumination Microscopy Reconstruction Using a Least-Squares Solver

Advances in Deep Learning for Super-Resolution Microscopy(Invited)

Deep Learning-Enabled Resolution-Enhancement in Mini- and Regular Microscopy for Biomedical Imaging

Deep learning enables structured illumination microscopy with low light levels and enhanced speed

High-Throughput Deep Learning Microscopy Using Multi-Angle Super-Resolution