Abstract:Fluorescence microscopy has enabled a dramatic development in modern biology by visualizing biological organisms with micrometer scale resolution. However, due to the diffraction limit, sub-micron/nanometer features are difficult to resolve. While various super-resolution techniques are developed to achieve nanometer-scale resolution, they often either require expensive optical setup or specialized fluorophores. In recent years, deep learning has shown the potentials to reduce the technical barrier and obtain super-resolution from diffraction-limited images. For accurate results, conventional deep learning techniques require thousands of images as a training dataset. Obtaining large datasets from biological samples is not often feasible due to the photobleaching of fluorophores, phototoxicity, and dynamic processes occurring within the organism. Therefore, achieving deep learning-based super-resolution using small datasets is challenging. We address this limitation with a new convolutional neural network-based approach that is successfully trained with small datasets and achieves super-resolution images. We captured 750 images in total from 15 different field-of-views as the training dataset to demonstrate the technique. In each FOV, a single target image is generated using the super-resolution radial fluctuation method. As expected, this small dataset failed to produce a usable model using traditional super-resolution architecture. However, using the new approach, a network can be trained to achieve super-resolution images from this small dataset. This deep learning model can be applied to other biomedical imaging modalities such as MRI and X-ray imaging, where obtaining large training datasets is challenging.

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Incorporating the Image Formation Process into Deep Learning Improves Network Performance

Deep Learning Enhanced Electrochemiluminescence Microscopy.

Image Enhancement For Fluorescence Microscopy Based On Deep Learning With Prior Knowledge Of Aberration

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Deep-learning Light-Field Microscopy with Improved Resolution and Reconstruction Speed

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model.

Deep Learning Based Fluorescence Microscopy Imaging Technologies and Applications

Deep learning enables structured illumination microscopy with low light levels and enhanced speed

Deep learning enables cross-modality super-resolution in fluorescence microscopy

Deep Learning Microscopy

DeepLearnMOR: a Deep-Learning Framework for Fluorescence Image-Based Classification of Organelle Morphology.

Deep Learning-Enhanced Fluorescence Microscopy Via Degeneration Decoupling.

Deep-learning-enhanced light-field microscopy

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Deep Learning Enables Confocal Laser-Scanning Microscopy with Enhanced Resolution

Deep learning-based super-resolution fluorescence microscopy on small datasets