Abstract:Automatic image segmentation is critical to scale up electron microscope (EM) connectome reconstruction. To this end, segmentation competitions, such as CREMI and SNEMI, exist to help researchers evaluate segmentation algorithms with the goal of improving them. Because generating ground truth is time-consuming, these competitions often fail to capture the challenges in segmenting larger datasets required in connectomics. More generally, the common metrics for EM image segmentation do not emphasize impact on downstream analysis and are often not very useful for isolating problem areas in the segmentation. For example, they do not capture connectivity information and often over-rate the quality of a segmentation as we demonstrate later. To address these issues, we introduce a novel strategy to enable evaluation of segmentation at large scales both in a supervised setting, where ground truth is available, or an unsupervised setting. To achieve this, we first introduce new metrics more closely aligned with the use of segmentation in downstream analysis and reconstruction. In particular, these include synapse connectivity and completeness metrics that provide both meaningful and intuitive interpretations of segmentation quality as it relates to the preservation of neuron connectivity. Also, we propose measures of segmentation correctness and completeness with respect to the percentage of "orphan" fragments and the concentrations of self-loops formed by segmentation failures, which are helpful in analysis and can be computed without ground truth. The introduction of new metrics intended to be used for practical applications involving large datasets necessitates a scalable software ecosystem, which is a critical contribution of this paper. To this end, we introduce a scalable, flexible software framework that enables integration of several different metrics and provides mechanisms to evaluate and debug differences between segmentations. We also introduce visualization software to help users to consume the various metrics collected. We evaluate our framework on two relatively large public groundtruth datasets providing novel insights on example segmentations.

Segmentation of Cortical Spreading Depression Wavefronts Through Local Similarity Metric

TWO-DIMENSIONAL VISUALIZATION OF THE PROPAGATION SPEED OF CORTICAL SPREADING DEPRESSION IN RAT CORTEX

Using Running Subtraction to Detect the Wavefront of Cortical Spreading Depression

Combine Temporal Clustering Analysis With Least Square Estimation To Determine The Dynamic Pattern Of Cortical Spreading Depression

Using Principal Component Analysis to Detect the Wavefront of Cortical Spreading Depression

A Neurocomputational Method for Fully Automated 3D Dendritic Spine Detection and Segmentation of Medium-Sized Spiny Neurons

Computation and Visualization of Spreading Depression Based on Reaction-Diffusion Equation with Recovery

Large Scale Image Segmentation with Structured Loss Based Deep Learning for Connectome Reconstruction

Simultaneous, live imaging of cortical spreading depression and associated cerebral blood flow changes, by combining voltage-sensitive dye and laser speckle contrast methods

Analyzing Image Segmentation for Connectomics

Time-Resolved Integrative Optical Imaging of Diffusion during Spreading Depression

Automated scalable segmentation of neurons from multispectral images

Automated Segmentation of White Matter Lesions Using Global Neighbourhood Given Contrast Feature-Based Random Forest and Markov Random Field

Segmentation of Synapses in Fluorescent Images using U-Net++ and Gabor-based Anisotropic Diffusion

A modular framework for multi-scale tissue imaging and neuronal segmentation

The 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

DEEP CONTEXTUAL RESIDUAL NETWORK FOR ELECTRON MICROSCOPY IMAGE SEGMENTATION IN CONNECTOMICS

In Vivo Optical Imaging Of Cortical Spreading Depression In Rat

Anat-SFSeg: Anatomically-guided superficial fiber segmentation with point-cloud deep learning

ACCURATELY DETERMINING PROPAGATION VELOCITY OF CORTICAL SPREADING DEPRESSION IN RATS BY OPTICAL INTRINSIC SIGNAL IMAGING

Cortical Sulcal Bank Segmentation Via Geometric Similarity Based Graph Partition