Abstract:Abstract The brain is a complex system that operates based on coordinated neuronal activities. Brain-wide cellular calcium imaging techniques have quickly advanced in recent years and become powerful tools for understanding the neuronal activities of small animal models. The whole brain imaging generally requires to extract the neuronal activities from three-dimensional (3D) image series. Unfortunately, the 3D image series are obtained under imaging conditions different among laboratories and extracting neuronal activities from the data requires multiple processes. Therefore researchers need to develop their own software, which has prevented the application of whole-brain imaging experiments in more laboratories. Here, we combined traditional image processing techniques with the powerful deep-learning method which can be flexibly modified to fit 3D image data in the nematode Caenorhabditis elegans obtained under different conditions. We first trained the 3D U-net deep network to classify each pixel into cell and non-cell categories. Cells merged as a whole region were further separated into individual cells by watershed segmentation. The cells were then tracked in 3D space over time with the combination of a feedforward network and a point set registration method to use local and global relative positions of the cells, respectively. Remarkably, one manually annotated 3D image combined with data augmentation was sufficient for training the deep networks to obtain satisfactory tracking results. Our method correctly tracked more than 98% of neurons in three different image datasets and successfully extracted brain-wide neuronal activities. Our method worked well even when the sampling rate was reduced: 86% correct in case 4/5 frames were removed, and when artificial noise was added into the raw images: 91% correct in case 35 times of background-level noise was added. Our results proved that deep learning is widely applicable to different datasets and can help us in establishing a flexible pipeline for extracting whole brain activities.

A deep-learning approach for online cell identification and trace extraction in functional two-photon calcium imaging

Fast and robust active neuron segmentation in two-photon calcium imaging using spatiotemporal deep learning

NeuroSeg: Automated Cell Detection and Segmentation for in Vivo Two-Photon Ca 2+ Imaging Data

Fast, scalable, and statistically robust cell extraction from large-scale neural calcium imaging datasets

Efficient Implementation of Convolutional Neural Networks in the Data Processing of Two-Photon In Vivo Imaging.

A Deep Learning-Based Approach for Efficient Detection and Classification of Local Ca2+ Release Events in Full-Frame Confocal Imaging

realSEUDO for real-time calcium imaging analysis

NeuroSeg-II: A Deep Learning Approach for Generalized Neuron Segmentation in Two-Photon Ca2+ Imaging

Deep-Learning-Based Detection of Neurons for Two-Photon Imaging Patch Clamp System in Vivo.

Efficient and accurate extraction of in vivo calcium signals from microendoscopic video data

An end-to-end recurrent compressed sensing method to denoise, detect and demix calcium imaging data

Classification of A Pressing Movement by Background Removed Single- photon Calcium Image Sequences

Deep-Learning-Based Segmentation of Cells and Analysis (DL-SCAN)

Fast, efficient, and accurate neuro-imaging denoising via supervised deep learning

Neurons Identification of Single-Photon Wide-Field Calcium Fluorescent Imaging Data

Real-Time Neuron Detection and Neural Signal Extraction Platform for Miniature Calcium Imaging.

Deep-learning-based flexible pipeline for segmenting and tracking cells in 3D image time series for whole brain imaging

Fast, Simple Calcium Imaging Segmentation with Fully Convolutional Networks

Automatic Neuron Detection in Calcium Imaging Data Using Convolutional Networks

CaImAn an open source tool for scalable calcium imaging data analysis

Rapid detection of neurons in widefield calcium imaging datasets after training with synthetic data