Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Rong Chen,Xiao Tang,Yuxuan Zhao,Zeyu Shen,Meng Zhang,Yusheng Shen,Tiantian Li,Casper Ho Yin Chung,Lijuan Zhang,Ji Wang,Binbin Cui,Peng Fei,Yusong Guo,Shengwang Du,Shuhuai Yao

DOI: https://doi.org/10.1038/s41467-023-38452-2

2023-05-19

Guangxue Jishu/Optical Technique

Abstract:Abstract Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.

What problem does this paper attempt to address?

This paper aims to address the challenges faced by single - molecule localization microscopy (SMLM) in live - cell imaging. Although SMLM can provide a spatial resolution ten times higher than that of traditional fluorescence microscopy, it requires thousands of frames of images to separate single - molecule fluorescence events, which greatly increases the image acquisition time and leads to increased phototoxicity, hindering the observation of transient intracellular dynamic processes. To solve these problems, researchers have developed a single - frame super - resolution microscopy technique (SFSRM) based on deep learning, which uses sub - pixel edge maps and multi - component optimization strategies to guide the neural network to reconstruct super - resolution images from a single diffraction - limited image.

SFSRM can achieve high - fidelity live - cell imaging under acceptable signal density and signal - to - noise ratio conditions, with a spatial - temporal resolution of 30 nanometers and 10 milliseconds, allowing long - term monitoring of intracellular dynamic processes, such as the interaction between mitochondria and the endoplasmic reticulum, the transport of vesicles along microtubules, and the fusion and fission of endosomes. In addition, this technique is adaptable to different microscopes and spectra, making it a useful tool in various imaging systems.