Abstract:Reconstruction of neuronal populations from ultra-scale optical microscopy (OM) images is essential to investigate neuronal circuits and brain mechanisms. The noises, low contrast, huge memory requirement, and high computational cost pose significant challenges in the neuronal population reconstruction. Recently, many studies have been conducted to extract neuron signals using deep neural networks (DNNs). However, training such DNNs usually relies on a huge amount of voxel-wise annotations in OM images, which are expensive in terms of both finance and labor. In this paper, we propose a novel framework for dense neuronal population reconstruction from ultra-scale images. To solve the problem of high cost in obtaining manual annotations for training DNNs, we propose a progressive learning scheme for neuronal population reconstruction (PLNPR) which does not require any manual annotations. Our PLNPR scheme consists of a traditional neuron tracing module and a deep segmentation network that mutually complement and progressively promote each other. To reconstruct dense neuronal populations from a terabyte-sized ultra-scale image, we introduce an automatic framework which adaptively traces neurons block by block and fuses fragmented neurites in overlapped regions continuously and smoothly. We build a dataset "VISoR-40" which consists of 40 large-scale OM image blocks from cortical regions of a mouse. Extensive experimental results on our VISoR-40 dataset and the public BigNeuron dataset demonstrate the effectiveness and superiority of our method on neuronal population reconstruction and single neuron reconstruction. Furthermore, we successfully apply our method to reconstruct dense neuronal populations from an ultra-scale mouse brain slice. The proposed adaptive block propagation and fusion strategies greatly improve the completeness of neurites in dense neuronal population reconstruction.

Optimization Algorithms in Reconstructions of Neuron Morphology: an Overview

Fast and Lightweight Network Improves Serial Brain Section Stitching

Semi-Automatic Neuron Tracing in Electron Microscope Images: Preliminary Results

From pixels to connections: exploring in vitro neuron reconstruction software for network graph generation

Complete Neuron Reconstruction Based on Branch Confidence

Neuronal Population Reconstruction From Ultra-Scale Optical Microscopy Images via Progressive Learning

PointNeuron: 3D Neuron Reconstruction via Geometry and Topology Learning of Point Clouds

NRTR: Neuron Reconstruction with Transformer from 3D Optical Microscopy Images

Fast reconstruction of water-tight surface mesh of neurons

Learning meaningful representation of single-neuron morphology via large-scale pre-training

A hierarchically annotated dataset drives tangled filament recognition in digital neuron reconstruction

Weakly Supervised Neuron Reconstruction From Optical Microscopy Images With Morphological Priors

Neuron tracing from light microscopy images: automation, deep learning and bench testing

Progressive Learning for Neuronal Population Reconstruction from Optical Microscopy Images

Graph-based cell pattern recognition for merging the multi-modal optical microscopic image of neurons

Reconstruction of Sparse Circuits Using Multi-neuronal Excitation (RESCUME)

Joint Learning Neuronal Skeleton and Brain Circuit Topology with Permutation Invariant Encoders for Neuron Classification

Gossamer: Scaling Image Processing and Reconstruction to Whole Brains

Deep MRI Reconstruction: Unrolled Optimization Algorithms Meet Neural Networks

Quality Control of Neuron Reconstruction Based on Deep Learning

Topological Skeletonization and Tree-Summarization of Neurons Using Discrete Morse Theory