Abstract:Fluorescence microscopy has enabled a dramatic development in modern biology by visualizing biological organisms with micrometer scale resolution. However, due to the diffraction limit, sub-micron/nanometer features are difficult to resolve. While various super-resolution techniques are developed to achieve nanometer-scale resolution, they often either require expensive optical setup or specialized fluorophores. In recent years, deep learning has shown the potentials to reduce the technical barrier and obtain super-resolution from diffraction-limited images. For accurate results, conventional deep learning techniques require thousands of images as a training dataset. Obtaining large datasets from biological samples is not often feasible due to the photobleaching of fluorophores, phototoxicity, and dynamic processes occurring within the organism. Therefore, achieving deep learning-based super-resolution using small datasets is challenging. We address this limitation with a new convolutional neural network-based approach that is successfully trained with small datasets and achieves super-resolution images. We captured 750 images in total from 15 different field-of-views as the training dataset to demonstrate the technique. In each FOV, a single target image is generated using the super-resolution radial fluctuation method. As expected, this small dataset failed to produce a usable model using traditional super-resolution architecture. However, using the new approach, a network can be trained to achieve super-resolution images from this small dataset. This deep learning model can be applied to other biomedical imaging modalities such as MRI and X-ray imaging, where obtaining large training datasets is challenging.

Deep learning enables cross-modality super-resolution in fluorescence microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Advances in Sub-20-nm Fluorescence Super-Resolution Microscopy(Invited)

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Deep learning-based super-resolution fluorescence microscopy on small datasets

High-throughput, high-resolution registration-free generated adversarial network microscopy

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Progress on Applications of Deep Learning in Super-Resolution Microscopy Imaging

Advances in Deep Learning for Super-Resolution Microscopy(Invited)

Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy

Deep learning-based super-resolution in coherent imaging systems

Deep Learning Microscopy

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model.

Deep Learning Based Fluorescence Microscopy Imaging Technologies and Applications

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Unsupervised deep learning enables blur-free super-resolution in two-photon microscopy

Dual stage processed 3D network super resolution for volumetric fluorescence microscopy far beyond throughput limit

High-throughput, high-resolution Generated Adversarial Network Microscopy.

Real-Time Resolution Enhancement of Confocal Laser Scanning Microscopy via Deep Learning