Abstract:Accurate morphological reconstruction of neurons in whole brain images is critical for brain science research. However, due to the wide range of whole brain imaging, uneven staining, and optical system fluctuations, there are significant differences in image properties between different regions of the ultrascale brain image, such as dramatically varying voxel intensities and inhomogeneous distribution of background noise, posing an enormous challenge to neuron reconstruction from whole brain images. In this paper, we propose an adaptive dual-task learning network (ADTL-Net) to quickly and accurately extract neuronal structures from ultrascale brain images. Specifically, this framework includes an External Features Classifier (EFC) and a Parameter Adaptive Segmentation Decoder (PASD), which share the same Multi-Scale Feature Encoder (MSFE). MSFE introduces an attention module named Channel Space Fusion Module (CSFM) to extract structure and intensity distribution features of neurons at different scales for addressing the problem of anisotropy in 3D space. Then, EFC is designed to classify these feature maps based on external features, such as foreground intensity distributions and image smoothness, and select specific PASD parameters to decode them of different classes to obtain accurate segmentation results. PASD contains multiple sets of parameters trained by different representative complex signal-to-noise distribution image blocks to handle various images more robustly. Experimental results prove that compared with other advanced segmentation methods for neuron reconstruction, the proposed method achieves state-of-the-art results in the task of neuron reconstruction from ultrascale brain images, with an improvement of about 49% in speed and 12% in F1 score.

DENSELY CONNECTED LARGE KERNEL CONVOLUTIONAL NETWORK FOR SEMANTIC MEMBRANE SEGMENTATION IN MICROSCOPY IMAGES

Deep residual contextual and subpixel convolution network for automated neuronal structure segmentation in micro-connectomics

Attention based morphological guided deep learning network for neuron segmentation in electron microscopy

Large Scale Image Segmentation with Structured Loss Based Deep Learning for Connectome Reconstruction

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

Enhancing Neural Segmentation on Low-Quality SEM Images Using Self-Attention Based Fusion Module with Auxiliary Deblurring Network

FusionNet: A Deep Fully Residual Convolutional Neural Network for Image Segmentation in Connectomics

An Iterative Convolutional Neural Network Algorithm Improves Electron Microscopy Image Segmentation

Dual-channel neural network for instance segmentation of synapse

DDeep3M+: Adaptive Enhancement Powered Weakly Supervised Learning for Neuron Segmentation.

Neuron Image Segmentation via Learning Deep Features and Enhancing Weak Neuronal Structures

Cross-dimension Affinity Distillation for 3D EM Neuron Segmentation

A 3D semantic segmentation network for accurate neuronal soma segmentation

Semi-Supervised Neuron Segmentation via Reinforced Consistency Learning

DVNet: A Memory-Efficient Three-Dimensional CNN for Large-Scale Neurovascular Reconstruction

Hierarchical Level Features Based Trainable Segmentation for Electron Microscopy Images

EM-NET: Centerline-Aware Mitochondria Segmentation in EM Images via Hierarchical View-Ensemble Convolutional Network

A General Deep Learning framework for Neuron Instance Segmentation based on Efficient UNet and Morphological Post-processing

Brain Image Segmentation for Ultrascale Neuron Reconstruction via an Adaptive Dual-Task Learning Network

DECTNet: Dual Encoder Network combined convolution and Transformer architecture for medical image segmentation

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs