Abstract:We investigate the ability of the pairwise maximum entropy (PME) model to describe the spiking activity of large populations of neurons recorded from the visual, auditory, motor, and somatosensory cortices. To quantify this performance, we use (1) Kullback-Leibler (KL) divergences, (2) the extent to which the pairwise model predicts third-order correlations, and (3) its ability to predict the probability that multiple neurons are simultaneously active. We compare these with the performance of a model with independent neurons and study the relationship between the different performance measures, while varying the population size, mean firing rate of the chosen population, and the bin size used for binarizing the data. We confirm the previously reported excellent performance of the PME model for small population sizes N < 20. But we also find that larger mean firing rates and bin sizes generally decreases performance. The performance for larger populations were generally not as good. For large populations, pairwise models may be good in terms of predicting third-order correlations and the probability of multiple neurons being active, but still significantly worse than small populations in terms of their improvement over the independent model in KL-divergence. We show that these results are independent of the cortical area and of whether approximate methods or Boltzmann learning are used for inferring the pairwise couplings. We compared the scaling of the inferred couplings with N and find it to be well explained by the Sherrington-Kirkpatrick (SK) model, whose strong coupling regime shows a complex phase with many metastable states. We find that, up to the maximum population size studied here, the fitted PME model remains outside its complex phase. However, the standard deviation of the couplings compared to their mean increases, and the model gets closer to the boundary of the complex phase as the population size grows. With recent major advances in recording technology, much of computational neuroscience has effectively turned into describing patterns in large amounts of data as succinctly as possible. One way to do this is to construct simple parametric models of the probability distribution over patterns of neuronal activity, such as the pairwise maximum entropy model. Intuitively, the pairwise model makes the distribution over all patterns as flat or uniform as possible, while keeping all firing rates and pairwise correlations the same as in the data. This model has been shown to effectively capture the observed distribution of activity patterns well for small populations (∼ 10), but it has not been systematically studied for large populations. Here, we study the performance of the pairwise model using a Neuropixel dataset recorded from the visual, auditory, somatosensory, and motor cortices of freely moving rats exposed to different stimuli. Consistent with previous findings, we find good performance for small populations, before it falls sharply as the population size increases (>∼ 25). However, we also find that this decrease in performance reveals interesting differences between the correlation structure of the data recorded under different sensory conditions.

Maximum entropy models reveal the excitatory and inhibitory correlation structures in cortical neuronal activity

Ensemble Inhibition and Excitation in the Human Cortex: an Ising Model Analysis with Uncertainties

Exact minimax entropy models of large-scale neuronal activity

Pairwise Ising model analysis of human cortical neuron recordings

Pairwise maximum entropy model explains the role of white matter structure in shaping emergent co-activation states

A pairwise maximum entropy model uncovers the white matter scaffold underlying emergent dynamics in intracranial EEG

Exact computation of the Maximum Entropy Potential of spiking neural networks models

Exactly solvable statistical physics models for large neuronal populations

Stimulus-dependent maximum entropy models of neural population codes

Statistical models of complex brain networks: a maximum entropy approach

Cellular Connectomes As Arbiters of Local Circuit Models in the Cerebral Cortex.

A Dynamical State Underlying the Second Order Maximum Entropy Principle in Neuronal Networks

Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition

Maximum Caliber Infers Effective Coupling and Response from Spiking Networks

Searching for collective behavior in a network of real neurons

Signatures of brain criticality unveiled by maximum entropy analysis across cortical states

The quality and complexity of pairwise maximum entropy models for large cortical populations

Modeling neural activity at the ensemble level

A statistical model for brain networks inferred from large-scale electrophysiological signals

Ising-like model replicating time-averaged spiking behaviour of in vitro neuronal networks

Topographic variation in neurotransmitter receptor densities explains differences in intracranial EEG spectra