Abstract:Calcium imaging is susceptible to motion distortions and background noises, particularly for monitoring active animals under low-dose laser irradiation, and hence unavoidably hinder the critical analysis of neural functions. Current research efforts tend to focus on either denoising or dewarping and do not provide effective methods for videos distorted by both noises and motion artifacts simultaneously. We found that when a self-supervised denoising model of DeepCAD [Nat. Methods18, 1359 (2021)10.1038/s41592-021-01225-0] is used on the calcium imaging contaminated by noise and motion warping, it can remove the motion artifacts effectively but with regenerated noises. To address this issue, we develop a two-level deep-learning (DL) pipeline to dewarp and denoise the calcium imaging video sequentially. The pipeline consists of two 3D self-supervised DL models that do not require warp-free and high signal-to-noise ratio (SNR) observations for network optimization. Specifically, a high-frequency enhancement block is presented in the denoising network to restore more structure information in the denoising process; a hierarchical perception module and a multi-scale attention module are designed in the dewarping network to tackle distortions of various sizes. Experiments conducted on seven videos from two-photon and confocal imaging systems demonstrate that our two-level DL pipeline can restore high-clarity neuron images distorted by both motion warping and background noises. Compared to typical DeepCAD, our denoising model achieves a significant improvement of approximately 30% in image resolution and up to 28% in signal-to-noise ratio; compared to traditional dewarping and denoising methods, our proposed pipeline network recovers more neurons, enhancing signal fidelity and improving data correlation among frames by 35% and 60% respectively. This work may provide an attractive method for long-term neural activity monitoring in awake animals and also facilitate functional analysis of neural circuits.

Classification of A Pressing Movement by Background Removed Single- photon Calcium Image Sequences

Continuous Prediction of Mice Lever-Pressing Kinematic Parameters by Background Removed Single-photon Calcium Images

Decoding With Calcium Signals From Layer 2/3 Motor Cortex During A Pressing Movement

Online Decoding System with Calcium Image from Mice Primary Motor Cortex.

Somatic Calcium Signals from Layer II/III Motor Cortex for Continuous Neural Decoding

An Open-Source Real-Time Motion Correction Plug-In for Single-Photon Calcium Imaging of Head-Mounted Microscopy

Decoding Forelimb Muscle Activity with Local Field Potentials from Mouse Motor Cortex

An end-to-end recurrent compressed sensing method to denoise, detect and demix calcium imaging data

Neurons Identification of Single-Photon Wide-Field Calcium Fluorescent Imaging Data

Simultaneous removal of noise and correction of motion warping in neuron calcium imaging using a pipeline structure of self-supervised deep learning models

Real-Time Calcium Imaging Based Neural Decoding with a Support Vector Machine.

End-to-end deep learning approach to mouse behavior classification from cortex-wide calcium imaging

A preprocessing toolbox for 2-photon subcellular calcium imaging

Neural Decoding Using Local Field Potential Based on Partial Least Squares Regression.

Neural Decoding on Imbalanced Calcium Imaging Data with a Network of Support Vector Machines

Efficient and accurate extraction of in vivo calcium signals from microendoscopic video data

Neural Decoding Using a Parallel Sequential Monte Carlo Method on Point Processes with Ensemble Effect.

Decoding multi-limb movements from two-photon calcium imaging of neuronal activity using deep learning

Real-Time Neuron Detection and Neural Signal Extraction Platform for Miniature Calcium Imaging.

Fast and Accurate Motion Correction for Two-Photon Ca 2+ Imaging in Behaving Mice.

A Study on Combining Local Field Potential and Single Unit Activity for Better Neural Decoding