Abstract:Patterns of microcircuitry suggest that the brain has an array of repeated canonical computational units. Yet neural representations are distributed, so the relevant computations may only be related indirectly to single-neuron transformations. It thus remains an open challenge how to define canonical distributed computations. We integrate normative and algorithmic theories of neural computation into a mathematical framework for inferring canonical distributed computations from large-scale neural activity patterns. At the normative level, we hypothesize that the brain creates a structured internal model of its environment, positing latent causes that explain its sensory inputs, and uses those sensory inputs to infer the latent causes. At the algorithmic level, we propose that this inference process is a nonlinear message-passing algorithm on a graph-structured model of the world. Given a time series of neural activity during a perceptual inference task, our framework finds (i) the neural representation of relevant latent variables, (ii) interactions between these variables that define the brain's internal model of the world, and (iii) message-functions specifying the inference algorithm. These targeted computational properties are then statistically distinguishable due to the symmetries inherent in any canonical computation, up to a global transformation. As a demonstration, we simulate recordings for a model brain that implicitly implements an approximate inference algorithm on a probabilistic graphical model. Given its external inputs and noisy neural activity, we recover the latent variables, their neural representation and dynamics, and canonical message-functions. We highlight features of experimental design needed to successfully extract canonical computations from neural data. Overall, this framework provides a new tool for discovering interpretable structure in neural recordings.

Statistical inference on representational geometries

Geometric and Topological Inference for Deep Representations of Complex Networks

Inferring Inference

The Topology and Geometry of Neural Representations

Raiders of the Lost HARK: a Reproducible Inference Framework for Big Data Science

Classical Statistics and Statistical Learning in Imaging Neuroscience

Quantifying the Multi-Scale Performance of Network Inference Algorithms

Tensor Graphical Model: Non-Convex Optimization and Statistical Inference

Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing

On the logic of hypothesis testing in functional imaging

High resolution behavioral and neural activity representation using a geometrical approach

Distilling Multi-Scale Neural Mechanisms from Diverse Unlabeled Experimental Data Using Deep Domain-Adaptive Inference Framework

Exploration, inference and prediction in neuroscience and biomedicine

Practical Bayesian Inference in Neuroscience: Or How I Learned To Stop Worrying and Embrace the Distribution

A large-scale examination of inductive biases shaping high-level visual representation in brains and machines

Generalized Shape Metrics on Neural Representations

Simultaneous Inference in Multiple Matrix-Variate Graphs for High-Dimensional Neural Recordings

Manifold-regression to predict from MEG/EEG brain signals without source modeling

Generative modeling of brain maps with spatial autocorrelation

Interpretable statistical representations of neural population dynamics and geometry

Bayesian Inference for Brain Activity from Functional Magnetic Resonance Imaging Collected at Two Spatial Resolutions