Abstract:Calcium imaging is susceptible to motion distortions and background noises, particularly for monitoring active animals under low-dose laser irradiation, and hence unavoidably hinder the critical analysis of neural functions. Current research efforts tend to focus on either denoising or dewarping and do not provide effective methods for videos distorted by both noises and motion artifacts simultaneously. We found that when a self-supervised denoising model of DeepCAD [Nat. Methods18, 1359 (2021)10.1038/s41592-021-01225-0] is used on the calcium imaging contaminated by noise and motion warping, it can remove the motion artifacts effectively but with regenerated noises. To address this issue, we develop a two-level deep-learning (DL) pipeline to dewarp and denoise the calcium imaging video sequentially. The pipeline consists of two 3D self-supervised DL models that do not require warp-free and high signal-to-noise ratio (SNR) observations for network optimization. Specifically, a high-frequency enhancement block is presented in the denoising network to restore more structure information in the denoising process; a hierarchical perception module and a multi-scale attention module are designed in the dewarping network to tackle distortions of various sizes. Experiments conducted on seven videos from two-photon and confocal imaging systems demonstrate that our two-level DL pipeline can restore high-clarity neuron images distorted by both motion warping and background noises. Compared to typical DeepCAD, our denoising model achieves a significant improvement of approximately 30% in image resolution and up to 28% in signal-to-noise ratio; compared to traditional dewarping and denoising methods, our proposed pipeline network recovers more neurons, enhancing signal fidelity and improving data correlation among frames by 35% and 60% respectively. This work may provide an attractive method for long-term neural activity monitoring in awake animals and also facilitate functional analysis of neural circuits.

Rapid deep widefield neuron finder driven by virtual calcium imaging data

Rapid detection of neurons in widefield calcium imaging datasets after training with synthetic data

InstantTrace: Fast Parallel Neuron Tracing on GPUs

High-resolution Focus-Tunable One-Photon Miniaturized Fluorescence Microscope for Imaging in Freely Moving Animals

Fast, efficient, and accurate neuro-imaging denoising via supervised deep learning

An end-to-end recurrent compressed sensing method to denoise, detect and demix calcium imaging data

Neurons Identification of Single-Photon Wide-Field Calcium Fluorescent Imaging Data

Efficient and accurate extraction of in vivo calcium signals from microendoscopic video data

A structured matrix factorization framework for large scale calcium imaging data analysis

Fast, scalable, and statistically robust cell extraction from large-scale neural calcium imaging datasets

Fast and robust active neuron segmentation in two-photon calcium imaging using spatiotemporal deep learning

Reinforcing Neuron Extraction and Spike Inference in Calcium Imaging Using Deep Self-Supervised Denoising

High-speed low-light in vivo two-photon voltage imaging of large neuronal populations

Decomposition-Estimation-Reconstruction: An Automatic and Accurate Neuron Extraction Paradigm

Rapid detection and recognition of whole brain activity in a freely behaving Caenorhabditis elegans

Reinforcing Neuron Extraction from Calcium Imaging Data Via Depth-Estimation Constrained Nonnegative Matrix Factorization

A Large Field-of-view, Single-cell-resolution Two- and Three-Photon Microscope for Deep Imaging

Penalized matrix decomposition for denoising, compression, and improved demixing of functional imaging data

High-speed, Large Field-of-view and Deep Imaging with an Adaptive Excitation Source

Simultaneous removal of noise and correction of motion warping in neuron calcium imaging using a pipeline structure of self-supervised deep learning models

Large-scale two-photon calcium imaging in freely moving mice