Abstract:An open challenge problem at the forefront of modern neuroscience is to obtain a comprehensive mapping of the neural pathways that underlie human brain function; an enhanced understanding of the wiring diagram of the brain promises to lead to new breakthroughs in diagnosing and treating neurological disorders. Inferring brain structure from image data, such as that obtained via electron microscopy (EM), entails solving the problem of identifying biological structures in large data volumes. Synapses, which are a key communication structure in the brain, are particularly difficult to detect due to their small size and limited contrast. Prior work in automated synapse detection has relied upon time-intensive biological preparations (post-staining, isotropic slice thicknesses) in order to simplify the problem. This paper presents VESICLE, the first known approach designed for mammalian synapse detection in anisotropic, non-post-stained data. Our methods explicitly leverage biological context, and the results exceed existing synapse detection methods in terms of accuracy and scalability. We provide two different approaches - one a deep learning classifier (VESICLE-CNN) and one a lightweight Random Forest approach (VESICLE-RF) to offer alternatives in the performance-scalability space. Addressing this synapse detection challenge enables the analysis of high-throughput imaging data soon expected to reach petabytes of data, and provide tools for more rapid estimation of brain-graphs. Finally, to facilitate community efforts, we developed tools for large-scale object detection, and demonstrated this framework to find $\approx$ 50,000 synapses in 60,000 $\mu m ^3$ (220 GB on disk) of electron microscopy data.

Annotating Synapses in Large EM Datasets

Large-scale EM Analysis of the Drosophila Antennal Lobe with Automatically Computed Synapse Point Clouds

Synaptic Cleft Segmentation in Non-Isotropic Volume Electron Microscopy of the Complete Drosophila Brain

High-Speed Automated Reconstruction of Drosophila Larval Brain from Volumetric EM Data

NeuronBridge: an intuitive web application for neuronal morphology search across large data sets

SynapseNet: Deep Learning for Automatic Synapse Reconstruction

3D Reconstruction of Synapses with Deep Learning Based on EM Images

Effective automated pipeline for 3D reconstruction of synapses based on deep learning

VESICLE: Volumetric Evaluation of Synaptic Interfaces using Computer vision at Large Scale

A Novel 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

The 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

Semi-Automatic Neuron Tracing in Electron Microscope Images: Preliminary Results

Fully Automatic Synaptic Cleft Detection and Segmentation from EM Images Based on Deep Learning

NEURD offers automated proofreading and feature extraction for connectomics

Automatically Segmenting and Reconstructing Neurons in SEM Images

Droplet-based Transcriptome Profiling of Individual Synapses.

An Automated Images-to-Graphs Framework for High Resolution Connectomics

Learning Multimodal Volumetric Features for Large-Scale Neuron Tracing

Toward Streaming Synapse Detection with Compositional ConvNets

Photoemission electron microscopy for connectomics

Detecting Synapse Location and Connectivity by Signed Proximity Estimation and Pruning with Deep Nets