Abstract:Neurons, with their elongated, tree-like dendritic and axonal structures, enable efficient signal integration and long-range communication across brain regions. By reconstructing individual neurons' morphology, we can gain valuable insights into brain connectivity, revealing the structure basis of cognition, movement, and perception. Despite the accumulation of extensive 3D microscopic imaging data, progress has been considerably hindered by the absence of automated tools to streamline this process. Here we introduce NeuroFly, a validated framework for large-scale automatic single neuron reconstruction. This framework breaks down the process into three distinct stages: segmentation, connection, and proofreading. In the segmentation stage, we perform automatic segmentation followed by skeletonization to generate over-segmented neuronal fragments without branches. During the connection stage, we use a 3D image-based path following approach to extend each fragment and connect it with other fragments of the same neuron. Finally, human annotators are required only to proofread the few unresolved positions. The first two stages of our process are clearly defined computer vision problems, and we have trained robust baseline models to solve them. We validated NeuroFly's efficiency using in-house datasets that include a variety of challenging scenarios, such as dense arborizations, weak axons, images with contamination. We will release the datasets along with a suite of visualization and annotation tools for better reproducibility. Our goal is to foster collaboration among researchers to address the neuron reconstruction challenge, ultimately accelerating advancements in neuroscience research. The dataset and code are available at <a class="link-external link-https" href="https://github.com/beanli161514/neurofly" rel="external noopener nofollow">this https URL</a>

A Soma Segmentation Benchmark in Full Adult Fly Brain

High-Speed Automated Reconstruction of Drosophila Larval Brain from Volumetric EM Data

3D Soma Detection in Large-Scale Whole Brain Images Via a Two-Stage Neural Network

A 3D semantic segmentation network for accurate neuronal soma segmentation

Automated And Accurate Detection Of Soma Location And Surface Morphology In Large-Scale 3d Neuron Images

NeuroFly: A framework for whole-brain single neuron reconstruction

Learning Multimodal Volumetric Features for Large-Scale Neuron Tracing

Large-scale EM Analysis of the Drosophila Antennal Lobe with Automatically Computed Synapse Point Clouds

Automatically Segmenting and Reconstructing Neurons in SEM Images

AxonEM Dataset: 3D Axon Instance Segmentation of Brain Cortical Regions

Semi-Automatic Neuron Tracing in Electron Microscope Images: Preliminary Results

Self-supervised Learning of Morphological Representation for 3D EM Segments with Cluster-Instance Correlations.

AxonCallosumEM Dataset: Axon Semantic Segmentation of Whole Corpus Callosum cross section from EM Images

A Novel 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

3D Reconstruction of Synapses with Deep Learning Based on EM Images

3D Cnn-Based Soma Segmentation from Brain Images at Single-Neuron Resolution

Large Scale Image Segmentation with Structured Loss Based Deep Learning for Connectome Reconstruction

The 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

3D Reconstruction of the Mitochondrial Network within the Neuronal Soma from SBF-SEM Volume Data

Synaptic Cleft Segmentation in Non-Isotropic Volume Electron Microscopy of the Complete Drosophila Brain

Segment Anything for Dendrites from Electron Microscopy