Abstract:Discovering how neural computations are implemented in the cortex at the level of monosynaptic connectivity requires probing for the existence of synapses from possibly thousands of presynaptic candidate neurons. Two-photon optogenetics has been shown to be a promising technology for mapping such monosynaptic connections via serial stimulation of neurons with single-cell resolution. However, this approach is limited in its ability to uncover connectivity at large scales because stimulating neurons one-by-one requires prohibitively long experiments. Here we developed novel computational tools that, when combined, enable learning of monosynaptic connectivity from high-speed holographic neural ensemble stimulation. First, we developed a model-based compressed sensing algorithm that identifies connections from postsynaptic responses evoked by stimulation of many neurons at once, considerably increasing the rate at which the existence and strength of synapses are screened. We show that this model-based approach, explicitly incorporating known biophysics of optogenetic mapping experiments, is critical for accurately determining synaptic connectivity using compressed sensing. Second, we developed a deep learning method that isolates the postsynaptic response evoked by each stimulus, allowing stimulation to rapidly switch between ensembles without waiting for the postsynaptic response to return to baseline. We then validated our approach by performing large-scale connectivity mapping experiments in slices from layer 2/3 of mouse primary visual cortex. Together, our system increases the throughput of monosynaptic connectivity mapping by an order of magnitude over existing approaches, enabling the acquisition of connectivity maps at speeds needed to discover the synaptic circuitry implementing neural computations.

Toward Streaming Synapse Detection with Compositional ConvNets

Fast and Lightweight Network Improves Serial Brain Section Stitching

Detecting Synapse Location and Connectivity by Signed Proximity Estimation and Pruning with Deep Nets

VESICLE: Volumetric Evaluation of Synaptic Interfaces using Computer vision at Large Scale

A Multi-Pass Approach to Large-Scale Connectomics

Synaptic Cleft Segmentation in Non-Isotropic Volume Electron Microscopy of the Complete Drosophila Brain

SynapseNet: Deep Learning for Automatic Synapse Reconstruction

A Novel 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

Effective automated pipeline for 3D reconstruction of synapses based on deep learning

The 3D Instance Segmentation Network for Synapse Reconstruction from Serial Electron Microscopy Images

Annotating Synapses in Large EM Datasets

Rapid learning of neural circuitry from holographic ensemble stimulation enabled by model-based compressed sensing

3D Reconstruction of Synapses with Deep Learning Based on EM Images

An Automated Images-to-Graphs Framework for High Resolution Connectomics

Semi-Automatic Neuron Tracing in Electron Microscope Images: Preliminary Results

Large Scale Image Segmentation with Structured Loss Based Deep Learning for Connectome Reconstruction

A Neurocomputational Method for Fully Automated 3D Dendritic Spine Detection and Segmentation of Medium-Sized Spiny Neurons

Detecting Synaptic Connections in Neural Systems Using Compressive Sensing

Light-microscopy based dense connectomic reconstruction of mammalian brain tissue

SynapsNet: Enhancing Neuronal Population Dynamics Modeling via Learning Functional Connectivity

Learning dynamic representations of the functional connectome in neurobiological networks