Abstract:Calcium imaging is susceptible to motion distortions and background noises, particularly for monitoring active animals under low-dose laser irradiation, and hence unavoidably hinder the critical analysis of neural functions. Current research efforts tend to focus on either denoising or dewarping and do not provide effective methods for videos distorted by both noises and motion artifacts simultaneously. We found that when a self-supervised denoising model of DeepCAD [Nat. Methods18, 1359 (2021)10.1038/s41592-021-01225-0] is used on the calcium imaging contaminated by noise and motion warping, it can remove the motion artifacts effectively but with regenerated noises. To address this issue, we develop a two-level deep-learning (DL) pipeline to dewarp and denoise the calcium imaging video sequentially. The pipeline consists of two 3D self-supervised DL models that do not require warp-free and high signal-to-noise ratio (SNR) observations for network optimization. Specifically, a high-frequency enhancement block is presented in the denoising network to restore more structure information in the denoising process; a hierarchical perception module and a multi-scale attention module are designed in the dewarping network to tackle distortions of various sizes. Experiments conducted on seven videos from two-photon and confocal imaging systems demonstrate that our two-level DL pipeline can restore high-clarity neuron images distorted by both motion warping and background noises. Compared to typical DeepCAD, our denoising model achieves a significant improvement of approximately 30% in image resolution and up to 28% in signal-to-noise ratio; compared to traditional dewarping and denoising methods, our proposed pipeline network recovers more neurons, enhancing signal fidelity and improving data correlation among frames by 35% and 60% respectively. This work may provide an attractive method for long-term neural activity monitoring in awake animals and also facilitate functional analysis of neural circuits.

Continuous Prediction of Mice Lever-Pressing Kinematic Parameters by Background Removed Single-photon Calcium Images

Classification of A Pressing Movement by Background Removed Single- photon Calcium Image Sequences

Somatic Calcium Signals from Layer II/III Motor Cortex for Continuous Neural Decoding

Online Decoding System with Calcium Image from Mice Primary Motor Cortex.

Decoding With Calcium Signals From Layer 2/3 Motor Cortex During A Pressing Movement

Fast and Accurate Decoding of Finger Movements from ECoG Through Riemannian Features and Modern Machine Learning Techniques

FPGA implementation of Kalman filter for neural ensemble decoding of rat's motor cortex

Neural Decoding Using a Parallel Sequential Monte Carlo Method on Point Processes with Ensemble Effect.

An Open-Source Real-Time Motion Correction Plug-In for Single-Photon Calcium Imaging of Head-Mounted Microscopy

Real-Time Calcium Imaging Based Neural Decoding with a Support Vector Machine.

Real-Time Neuron Detection and Neural Signal Extraction Platform for Miniature Calcium Imaging.

Decoding multi-limb movements from two-photon calcium imaging of neuronal activity using deep learning

An end-to-end recurrent compressed sensing method to denoise, detect and demix calcium imaging data

Neural Decoding Based on Probabilistic Neural Network

Neural Decoding on Imbalanced Calcium Imaging Data with a Network of Support Vector Machines

Decoding Forelimb Muscle Activity with Local Field Potentials from Mouse Motor Cortex

Decoding the Nonstationary Neural Activity in Motor Cortex for Brain Machine Interfaces

FPGA-Based In-Vivo Calcium Image Decoding for Closed-Loop Feedback Applications

Simultaneous removal of noise and correction of motion warping in neuron calcium imaging using a pipeline structure of self-supervised deep learning models

Neural Decoding Using Local Field Potential Based on Partial Least Squares Regression.

Efficient and accurate extraction of in vivo calcium signals from microendoscopic video data