Abstract:The development of two-photon microscopy and Ca2+ indicators has enabled the recording of multiscale neuronal activities in vivo and thus advanced the understanding of brain functions. However, it is challenging to perform automatic, accurate, and generalized neuron segmentation when processing a large amount of imaging data. Here, we propose a novel deep-learning-based neural network, termed as NeuroSeg-II, to conduct automatic neuron segmentation for in vivo two-photon Ca2+ imaging data. This network architecture is based on Mask region-based convolutional neural network (R-CNN) but has enhancements of an attention mechanism and modified feature hierarchy modules. We added an attention mechanism module to focus the computation on neuron regions in imaging data. We also enhanced the feature hierarchy to extract feature information at diverse levels. To incorporate both spatial and temporal information in our data processing, we fused the images from average projection and correlation map extracting the temporal information of active neurons, and the integrated information was expressed as two-dimensional (2D) images. To achieve a generalized neuron segmentation, we conducted a hybrid learning strategy by training our model with imaging data from different labs, including multiscale data with different Ca2+ indicators. The results showed that our approach achieved promising segmentation performance across different imaging scales and Ca2+ indicators, even including the challenging data of large field-of-view mesoscopic images. By comparing state-of-the-art neuron segmentation methods for two-photon Ca2+ imaging data, we showed that our approach achieved the highest accuracy with a publicly available dataset. Thus, NeuroSeg-II enables good segmentation accuracy and a convenient training and testing process.

CalciSeg: A versatile approach for unsupervised segmentation of calcium imaging data

NeuroSeg: Automated Cell Detection and Segmentation for in Vivo Two-Photon Ca 2+ Imaging Data

An end-to-end recurrent compressed sensing method to denoise, detect and demix calcium imaging data

CellSeg: a robust, pre-trained nucleus segmentation and pixel quantification software for highly multiplexed fluorescence images

NeuroSeg-III: Efficient Neuron Segmentation in Two-Photon Ca2+ Imaging Data Using Self-Supervised Learning

Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasets

Fast and robust active neuron segmentation in two-photon calcium imaging using spatiotemporal deep learning

CRISP: Correlation-Refined Image Segmentation Process

Fast, Simple Calcium Imaging Segmentation with Fully Convolutional Networks

NeuroSeg-II: A Deep Learning Approach for Generalized Neuron Segmentation in Two-Photon Ca2+ Imaging

CaImAn an open source tool for scalable calcium imaging data analysis

A modular framework for multi-scale tissue imaging and neuronal segmentation

Segmentor: a tool for manual refinement of 3D microscopy annotations

ColabSeg: An interactive tool for editing, processing, and visualizing membrane segmentations from cryo-ET data

Robust Segmentation of Brain MRI in the Wild with Hierarchical CNNs and no Retraining

DISCo: Deep learning, Instance Segmentation, and Correlations for cell segmentation in calcium imaging

Isegmsi: an Interactive Strategy to Improve Spatial Segmentation of Mass Spectrometry Imaging Data.

SCALPEL: Extracting neurons from calcium imaging data

Segmentation Of Mitochondria Based On Sem Images

aiSEGcell: User-friendly deep learning-based segmentation of nuclei in transmitted light images

DeepBrainSeg: Automated Brain Region Segmentation for Micro-Optical Images with a Convolutional Neural Network