Abstract:SignificanceSpectroscopic single-molecule localization microscopy (sSMLM) takes advantage of nanoscopy and spectroscopy, enabling sub-10 nm resolution as well as simultaneous multicolor imaging of multi-labeled samples. Reconstruction of raw sSMLM data using deep learning is a promising approach for visualizing the subcellular structures at the nanoscale.AimDevelop a novel computational approach leveraging deep learning to reconstruct both label-free and fluorescence-labeled sSMLM imaging data.ApproachWe developed a two-network-model based deep learning algorithm, termed DsSMLM, to reconstruct sSMLM data. The effectiveness of DsSMLM was assessed by conducting imaging experiments on diverse samples, including label-free single-stranded DNA (ssDNA) fiber, fluorescence-labeled histone markers on COS-7 and U2OS cells, and simultaneous multicolor imaging of synthetic DNA origami nanoruler.ResultsFor label-free imaging, a spatial resolution of 6.22 nm was achieved on ssDNA fiber; for fluorescence-labeled imaging, DsSMLM revealed the distribution of chromatin-rich and chromatin-poor regions defined by histone markers on the cell nucleus and also offered simultaneous multicolor imaging of nanoruler samples, distinguishing two dyes labeled in three emitting points with a separation distance of 40 nm. With DsSMLM, we observed enhanced spectral profiles with 8.8% higher localization detection for single-color imaging and up to 5.05% higher localization detection for simultaneous two-color imaging.ConclusionsWe demonstrate the feasibility of deep learning-based reconstruction for sSMLM imaging applicable to label-free and fluorescence-labeled sSMLM imaging data. We anticipate our technique will be a valuable tool for high-quality super-resolution imaging for a deeper understanding of DNA molecules' photophysics and will facilitate the investigation of multiple nanoscopic cellular structures and their interactions.

A Deep‐Learning Framework for the Automated Recognition of Molecules in Scanning‐Probe‐Microscopy Images

A deep learning framework for automated molecular recognitions in scanning probe microscopy images.

Machine Vision Automated Chiral Molecule Detection and Classification in Molecular Imaging

Applying a Deep-Learning-Based Keypoint Detection in Analyzing Surface Nanostructures

Artificial-intelligence-driven scanning probe microscopy

Autonomous Scanning Tunneling Microscopy Imaging via Deep Learning

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

Precise Large-Scale Chemical Transformations on Surfaces: Deep Learning Meets Scanning Probe Microscopy with Interpretability

ABC-Net: a Divide-and-conquer Based Deep Learning Architecture for SMILES Recognition from Molecular Images.

A Deep Learning Approach for Molecular Classification Based on AFM Images

Deep-Learning Recognition of Scanning Transmission Electron Microscopy: Quantifying and Mitigating the Influence of Gaussian Noises

Chirality Detection in Scanning Tunneling Microscopy Data Using Artificial Intelligence

DECIMER: towards deep learning for chemical image recognition

3D Single Molecule Localization Microscopy Via Deep Learning

OCMR: A comprehensive framework for optical chemical molecular recognition

Deep learning-based spectroscopic single-molecule localization microscopy

Nanoparticle Recognition on Scanning Probe Microscopy Images Using Computer Vision and Deep Learning

Deep learning for electron and scanning probe microscopy: From materials design to atomic fabrication

Deep Learning for Atomically Resolved Imaging

Deep-learning-augmented Microscopy for Super-Resolution Imaging of Nanoparticles.

High Resolution of Plasmonic Resonance Scattering Imaging with Deep Learning