Abstract:Fluorescence microscopy has enabled a dramatic development in modern biology by visualizing biological organisms with micrometer scale resolution. However, due to the diffraction limit, sub-micron/nanometer features are difficult to resolve. While various super-resolution techniques are developed to achieve nanometer-scale resolution, they often either require expensive optical setup or specialized fluorophores. In recent years, deep learning has shown the potentials to reduce the technical barrier and obtain super-resolution from diffraction-limited images. For accurate results, conventional deep learning techniques require thousands of images as a training dataset. Obtaining large datasets from biological samples is not often feasible due to the photobleaching of fluorophores, phototoxicity, and dynamic processes occurring within the organism. Therefore, achieving deep learning-based super-resolution using small datasets is challenging. We address this limitation with a new convolutional neural network-based approach that is successfully trained with small datasets and achieves super-resolution images. We captured 750 images in total from 15 different field-of-views as the training dataset to demonstrate the technique. In each FOV, a single target image is generated using the super-resolution radial fluctuation method. As expected, this small dataset failed to produce a usable model using traditional super-resolution architecture. However, using the new approach, a network can be trained to achieve super-resolution images from this small dataset. This deep learning model can be applied to other biomedical imaging modalities such as MRI and X-ray imaging, where obtaining large training datasets is challenging.

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Ultra-fast, Universal Super-Resolution Radial Fluctuations (SRRF) Algorithm for Live-Cell Super-Resolution Microscopy.

Super-resolution Microscopy and Its Applications in Neuroscience

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Progress on Applications of Deep Learning in Super-Resolution Microscopy Imaging

Deep learning enables cross-modality super-resolution in fluorescence microscopy

Deep learning-based super-resolution fluorescence microscopy on small datasets

Deep-learning accelerated super-resolution radial fluctuations (SRRF) enables real-time live cell imaging

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes

Advanced Imaging Integration: Multi-Modal Raman Light Sheet Microscopy Combined with Zero-Shot Learning for Denoising and Super-Resolution

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Large-field and Fast Super-Resolution Microscopic Imaging Method based on Laser Interferometry

Fast imaging of 15 intracellular compartments and interactions by deep learning segmentation of super-resolution data