Abstract:Fluorescence microscopy has enabled a dramatic development in modern biology by visualizing biological organisms with micrometer scale resolution. However, due to the diffraction limit, sub-micron/nanometer features are difficult to resolve. While various super-resolution techniques are developed to achieve nanometer-scale resolution, they often either require expensive optical setup or specialized fluorophores. In recent years, deep learning has shown the potentials to reduce the technical barrier and obtain super-resolution from diffraction-limited images. For accurate results, conventional deep learning techniques require thousands of images as a training dataset. Obtaining large datasets from biological samples is not often feasible due to the photobleaching of fluorophores, phototoxicity, and dynamic processes occurring within the organism. Therefore, achieving deep learning-based super-resolution using small datasets is challenging. We address this limitation with a new convolutional neural network-based approach that is successfully trained with small datasets and achieves super-resolution images. We captured 750 images in total from 15 different field-of-views as the training dataset to demonstrate the technique. In each FOV, a single target image is generated using the super-resolution radial fluctuation method. As expected, this small dataset failed to produce a usable model using traditional super-resolution architecture. However, using the new approach, a network can be trained to achieve super-resolution images from this small dataset. This deep learning model can be applied to other biomedical imaging modalities such as MRI and X-ray imaging, where obtaining large training datasets is challenging.

Deep learning enhanced super-resolution x-ray fluorescence microscopy by a dual-branch network

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Advances in Sub-20-nm Fluorescence Super-Resolution Microscopy(Invited)

Deep Learning for Super-Resolution in a Field Emission Scanning Electron Microscope

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Deep learning enables cross-modality super-resolution in fluorescence microscopy

Far-Field Super-Resolution Imaging Using Near-Field Illumination by Micro-Fiber

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Highly sensitive 2D X-ray absorption spectroscopy via physics informed machine learning

Deep Learning-Based Super-Resolution and De-Noising for XMM-Newton Images

Deep learning of multi-resolution X-Ray micro-CT images for multi-scale modelling

Deep Learning Fluorescence Imaging of Visible to NIR‐II Based on Modulated Multimode Emissions Lanthanide Nanocrystals

X-ray Scattering Image Classification Using Deep Learning

Deep learning enables contrast-robust super-resolution reconstruction in structured illumination microscopy

Deep learning-based super-resolution fluorescence microscopy on small datasets

Super resolution Method for Radiation Image Based on Deep Learning

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Deep-learning accelerated super-resolution radial fluctuations (SRRF) enables real-time live cell imaging

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence