Abstract:Pairwise maximum-entropy models have been used in recent neuroscientific literature to predict the activity of neuronal populations, given only the time-averaged correlations of the neuron activities. This paper provides evidence that the pairwise model, applied to experimental recordings, predicts a bimodal distribution for the population-averaged activity, and for some population sizes the second mode peaks at high activities, with 90% of the neuron population active within time-windows of few milliseconds. This bimodality has several undesirable consequences: 1. The presence of two modes is unrealistic in view of observed neuronal activity. 2. The prediction of a high-activity mode is unrealistic on neurobiological grounds. 3. Boltzmann learning becomes non-ergodic, hence the pairwise model found by this method is not the maximum entropy distribution; similarly, solving the inverse problem by common variants of mean-field approximations has the same problem. 4. The Glauber dynamics associated with the model is either unrealistically bistable, or does not reflect the distribution of the pairwise model. This bimodality is first demonstrated for an experimental dataset comprising 159 neuron activities recorded from the motor cortex of macaque monkey. Using a reduced maximum-entropy model, evidence is then provided that this bimodality affects typical neural recordings of population sizes of a couple of hundreds or more neurons. As a way to eliminate the bimodality and its ensuing problems, a modified pairwise model is presented, which -- most important -- has an associated pairwise Glauber dynamics. This model avoids bimodality thanks to a minimal asymmetric inhibition. It can be interpreted as a minimum-relative-entropy model with a particular prior, or as a maximum-entropy model with an additional constraint.

A Dynamical State Underlying the Second Order Maximum Entropy Principle in Neuronal Networks

Exactly solvable statistical physics models for large neuronal populations

Exact minimax entropy models of large-scale neuronal activity

Exact computation of the Maximum Entropy Potential of spiking neural networks models

Maximum Entropy Principle Analysis in Network Systems with Short-Time Recordings

Thermodynamic analog of integrate-and-fire neuronal networks by maximum entropy modelling

Maximum entropy models reveal the excitatory and inhibitory correlation structures in cortical neuronal activity

Maximum entropy in dynamic complex networks

Dynamical and Coupling Structure of Pulse-Coupled Networks in Maximum Entropy Analysis

On the sufficiency of pairwise interactions in maximum entropy models of biological networks

Maximum Caliber Infers Effective Coupling and Response from Spiking Networks

The determining role of covariances in large networks of stochastic neurons

Ising-like model replicating time-averaged spiking behaviour of in vitro neuronal networks

Neuronal Computation Using High-Order Statistics

Non-exchangeable networks of integrate-and-fire neurons: spatially-extended mean-field limit of the empirical measure

Searching for collective behavior in a network of real neurons

Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition

Statistical mechanics for networks of real neurons

Maximum entropy change and least action principle for nonequilibrium systems