Surmounting photon limits and motion artifacts for biological dynamics imaging via dual-perspective self-supervised learning

Binglin Shen,Chenggui Luo,Wen Pang,Yajing Jiang,Wenbo Wu,Rui Hu,Junle Qu,Bobo Gu,Liwei Liu
DOI: https://doi.org/10.1186/s43074-023-00117-0
IF: 16.5
2024-01-08
PhotoniX
Abstract:Visualizing rapid biological dynamics like neuronal signaling and microvascular flow is crucial yet challenging due to photon noise and motion artifacts. Here we present a deep learning framework for enhancing the spatiotemporal relations of optical microscopy data. Our approach leverages correlations of mirrored perspectives from conjugated scan paths, training a model to suppress noise and motion blur by restoring degraded spatial features. Quantitative validation on vibrational calcium imaging validates significant gains in spatiotemporal correlation (2.2×), signal-to-noise ratio (9–12 dB), structural similarity (6.6×), and motion tolerance compared to raw data. We further apply the framework to diverse in viv o experiments from mouse cerebral hemodynamics to zebrafish cardiac dynamics. This approach enables the clear visualization of the rapid nutrient flow (30 mm/s) in microcirculation and the systolic and diastolic processes of heartbeat (2.7 cycle/s), as well as cellular and vascular structure in deep cortex. Unlike techniques relying on temporal correlations, learning inherent spatial priors avoids motion-induced artifacts. This self-supervised strategy flexibly enhances live microscopy under photon-limited and motion-prone regimes.
optics
What problem does this paper attempt to address?