Abstract:The development of two-photon microscopy and Ca2+ indicators has enabled the recording of multiscale neuronal activities in vivo and thus advanced the understanding of brain functions. However, it is challenging to perform automatic, accurate, and generalized neuron segmentation when processing a large amount of imaging data. Here, we propose a novel deep-learning-based neural network, termed as NeuroSeg-II, to conduct automatic neuron segmentation for in vivo two-photon Ca2+ imaging data. This network architecture is based on Mask region-based convolutional neural network (R-CNN) but has enhancements of an attention mechanism and modified feature hierarchy modules. We added an attention mechanism module to focus the computation on neuron regions in imaging data. We also enhanced the feature hierarchy to extract feature information at diverse levels. To incorporate both spatial and temporal information in our data processing, we fused the images from average projection and correlation map extracting the temporal information of active neurons, and the integrated information was expressed as two-dimensional (2D) images. To achieve a generalized neuron segmentation, we conducted a hybrid learning strategy by training our model with imaging data from different labs, including multiscale data with different Ca2+ indicators. The results showed that our approach achieved promising segmentation performance across different imaging scales and Ca2+ indicators, even including the challenging data of large field-of-view mesoscopic images. By comparing state-of-the-art neuron segmentation methods for two-photon Ca2+ imaging data, we showed that our approach achieved the highest accuracy with a publicly available dataset. Thus, NeuroSeg-II enables good segmentation accuracy and a convenient training and testing process.

Dual-channel neural network for instance segmentation of synapse

The 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

A Novel 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

Segmentation of Synapses in Fluorescent Images using U-Net++ and Gabor-based Anisotropic Diffusion

SynapseNet: Deep Learning for Automatic Synapse Reconstruction

Fully Automatic Synaptic Cleft Detection and Segmentation from EM Images Based on Deep Learning

Domain Adaptive Synapse Detection with Weak Point Annotations

A General Deep Learning framework for Neuron Instance Segmentation based on Efficient UNet and Morphological Post-processing

DENSELY CONNECTED LARGE KERNEL CONVOLUTIONAL NETWORK FOR SEMANTIC MEMBRANE SEGMENTATION IN MICROSCOPY IMAGES

Enhancing Neural Segmentation on Low-Quality SEM Images Using Self-Attention Based Fusion Module with Auxiliary Deblurring Network

NeuroSeg-II: A Deep Learning Approach for Generalized Neuron Segmentation in Two-Photon Ca2+ Imaging

3D Reconstruction of Synapses with Deep Learning Based on EM Images

Brain Image Segmentation for Ultrascale Neuron Reconstruction via an Adaptive Dual-Task Learning Network

Effective automated pipeline for 3D reconstruction of synapses based on deep learning

Synaptic Cleft Segmentation in Non-Isotropic Volume Electron Microscopy of the Complete Drosophila Brain

Automatically Segmenting and Reconstructing Neurons in SEM Images

Accurate Segmentation of Synaptic Cleft with Contour Growing Concatenated with a Convnet

DECTNet: Dual Encoder Network combined convolution and Transformer architecture for medical image segmentation

Deep learning and shapes similarity for joint segmentation and tracing single neurons in SEM images.

Semi-Supervised Neuron Segmentation via Reinforced Consistency Learning

An Effective Dual-Scale Hybrid Encoder Network for Medical Image Segmentation