Abstract:Artificial intelligence algorithms that aid mini-microscope imaging are attractive for numerous applications. In this paper, we optimize artificial intelligence techniques to provide clear, and natural biomedical imaging. We demonstrate that a deep learning-enabled super-resolution method can significantly enhance the spatial resolution of mini-microscopy and regular-microscopy. This data-driven approach trains a generative adversarial network to transform low-resolution images into super-resolved ones. Mini-microscopic images and regular-microscopic images acquired with different optical microscopes under various magnifications are collected as our experimental benchmark datasets. The only input to this generative-adversarial-network-based method are images from the datasets down-sampled by the Bicubic interpolation. We use independent test set to evaluate this deep learning approach with other deep learning-based algorithms through qualitative and quantitative comparisons. To clearly present the improvements achieved by this generative-adversarial-network-based method, we zoom into the local features to explore and highlight the qualitative differences. We also employ the peak signal-to-noise ratio and the structural similarity, to quantitatively compare alternative super-resolution methods. The quantitative results illustrate that super-resolution images obtained from our approach with interpolation parameter α=0.25 more closely match those of the original high-resolution images than to those obtained by any of the alternative state-of-the-art method. These results are significant for fields that use microscopy tools, such as biomedical imaging of engineered living systems. We also utilize this generative adversarial network-based algorithm to optimize the resolution of biomedical specimen images and then generate three-dimensional reconstruction, so as to enhance the ability of three-dimensional imaging throughout the entire volumes for spatial-temporal analyses of specimen structures.

Toward a Thinking Microscope: Deep Learning in Optical Microscopy and Image Reconstruction

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Deep Learning Microscopy

Deep learning-based image processing in optical microscopy

Roadmap on Deep Learning for Microscopy

A Survey on Applications of Deep Learning in Microscopy Image Analysis

The Rise of Data-Driven Microscopy powered by Machine Learning

Review: Deep Learning in Electron Microscopy

Deep Learning Based Fluorescence Microscopy Imaging Technologies and Applications

Deep Learning Analysis on Microscopic Imaging in Materials Science

Deep learning in macroscopic diffuse optical imaging

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

A Perspective on Deep Imaging

The rise of data‐driven microscopy powered by machine learning

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Deep Learning-Enabled Resolution-Enhancement in Mini- and Regular Microscopy for Biomedical Imaging

Deep learning in biomedical optics

Advancing electron microscopy using deep learning

Deep-learning-enhanced light-field microscopy

Deep learning for electron and scanning probe microscopy: From materials design to atomic fabrication

Advances in Deep Learning for Super-Resolution Microscopy(Invited)