Abstract:SignificanceSpectroscopic single-molecule localization microscopy (sSMLM) takes advantage of nanoscopy and spectroscopy, enabling sub-10 nm resolution as well as simultaneous multicolor imaging of multi-labeled samples. Reconstruction of raw sSMLM data using deep learning is a promising approach for visualizing the subcellular structures at the nanoscale.AimDevelop a novel computational approach leveraging deep learning to reconstruct both label-free and fluorescence-labeled sSMLM imaging data.ApproachWe developed a two-network-model based deep learning algorithm, termed DsSMLM, to reconstruct sSMLM data. The effectiveness of DsSMLM was assessed by conducting imaging experiments on diverse samples, including label-free single-stranded DNA (ssDNA) fiber, fluorescence-labeled histone markers on COS-7 and U2OS cells, and simultaneous multicolor imaging of synthetic DNA origami nanoruler.ResultsFor label-free imaging, a spatial resolution of 6.22 nm was achieved on ssDNA fiber; for fluorescence-labeled imaging, DsSMLM revealed the distribution of chromatin-rich and chromatin-poor regions defined by histone markers on the cell nucleus and also offered simultaneous multicolor imaging of nanoruler samples, distinguishing two dyes labeled in three emitting points with a separation distance of 40 nm. With DsSMLM, we observed enhanced spectral profiles with 8.8% higher localization detection for single-color imaging and up to 5.05% higher localization detection for simultaneous two-color imaging.ConclusionsWe demonstrate the feasibility of deep learning-based reconstruction for sSMLM imaging applicable to label-free and fluorescence-labeled sSMLM imaging data. We anticipate our technique will be a valuable tool for high-quality super-resolution imaging for a deeper understanding of DNA molecules' photophysics and will facilitate the investigation of multiple nanoscopic cellular structures and their interactions.

Multicolor localization microscopy by deep learning

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Deep learning-based spectroscopic single-molecule localization microscopy

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Deep Learning Microscopy

Deep learning-based color holographic microscopy

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Deep learning enables cross-modality super-resolution in fluorescence microscopy

Deep learning-driven adaptive optics for single-molecule localization microscopy

High-axial-resolution Single-Molecule Localization under Dense Excitation with a Multi-Channel Deep U-Net.

3D Single Molecule Localization Microscopy Via Deep Learning

Localization of Ultra-dense Emitters with Neural Networks

Multi-color correlative light and electron microscopy using nanoparticle cathodoluminescence

Roadmap on Deep Learning for Microscopy

Deep Learning for Super-Resolution Localization Microscopy

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Advanced Imaging Integration: Multi-Modal Raman Light Sheet Microscopy Combined with Zero-Shot Learning for Denoising and Super-Resolution