Abstract:Digital reconstruction or tracing of 3D tree-like neuronal structures from optical microscopy images is essential for understanding the functionality of neurons and reveal the connectivity of neuronal networks. Despite the existence of numerous tracing methods, reconstructing a neuron from highly noisy images remains challenging, particularly for neurites with low and inhomogeneous intensities. Conducting deep convolutional neural network (CNN)-based segmentation prior to neuron tracing facilitates an approach to solving this problem via separation of weak neurites from a noisy background. However, large manual annotations are needed in deep learning-based methods, which is labor-intensive and limits the algorithm's generalization for different datasets. In this study, we present a weakly supervised learning method of a deep CNN for neuron reconstruction without manual annotations. Specifically, we apply a 3D residual CNN as the architecture for discriminative neuronal feature extraction. We construct the initial pseudo-labels (without manual segmentation) of the neuronal images on the basis of an existing automatic tracing method. A weakly supervised learning framework is proposed via iterative training of the CNN model for improved prediction and refining of the pseudo-labels to update training samples. The pseudo-label was iteratively modified via mining and addition of weak neurites from the CNN predicted probability map on the basis of their tubularity and continuity. The proposed method was evaluated on several challenging images from the public BigNeuron and Diadem datasets, to fMOST datasets. Owing to the adaption of 3D deep CNNs and weakly supervised learning, the presented method demonstrates effective detection of weak neurites from noisy images and achieves results similar to those of the CNN model with manual annotations. The tracing performance was significantly improved by the proposed method on both small and large datasets (>100 GB). Moreover, the proposed method proved to be superior to several novel tracing methods on original images. The results obtained on various large-scale datasets demonstrated the generalization and high precision achieved by the proposed method for neuron reconstruction.

Towards Computational Analytics of 3D Neuron Images Using Deep Adversarial Learning

Deep Feature Representation For The Computational Analytics Of 3d Neuronal Morphology

Large-scale Exploration of Neuronal Morphologies Using Deep Learning and Augmented Reality.

A Neurocomputational Method for Fully Automated 3D Dendritic Spine Detection and Segmentation of Medium-Sized Spiny Neurons

Weakly Supervised Neuron Reconstruction From Optical Microscopy Images With Morphological Priors

Neuron Image Segmentation via Learning Deep Features and Enhancing Weak Neuronal Structures

Weakly Supervised Learning of 3D Deep Network for Neuron Reconstruction

Cross-dimension Affinity Distillation for 3D EM Neuron Segmentation

Deep-Learning-Based Automated Neuron Reconstruction from 3D Microscopy Images Using Synthetic Training Images.

PointNeuron: 3D Neuron Reconstruction via Geometry and Topology Learning of Point Clouds

3D Neuron Microscopy Image Segmentation Via the Ray-Shooting Model and a DC-BLSTM Network.

DINeuro: Distilling Knowledge from 2D Natural Images via Deformable Tubular Transferring Strategy for 3D Neuron Reconstruction

A deep learning-based strategy for producing dense 3D segmentations from sparsely annotated 2D images

Data-Driven Morphological Feature Perception of Single Neuron with Graph Neural Network.

An Efficient Method for Neuronal Tracking in Electron Microscopy Images

DDeep3M+: Adaptive Enhancement Powered Weakly Supervised Learning for Neuron Segmentation.

A hierarchically annotated dataset drives tangled filament recognition in digital neuron reconstruction

Effective automated pipeline for 3D reconstruction of synapses based on deep learning

BigNeuron: A Resource to Benchmark and Predict Best-Performing Algorithms for Automated Reconstruction of Neuronal Morphology

Using Simulated Training Data of Voxel-Level Generative Models to Improve 3D Neuron Reconstruction

An Adversarial And Densely Dilated Network For Connectomes Segmentation