Abstract:The nature of neural codes is central to neuroscience. Do neurons encode information through relatively slow changes in the firing rates of individual spikes (rate code) or by the precise timing of every spike (temporal code)? Here we compare the loss of information due to correlations for these two possible neural codes. The essence of Shannon's definition of information is to combine information with uncertainty: the higher the uncertainty of a given event, the more information is conveyed by that event. Correlations can reduce uncertainty or the amount of information, but by how much? In this paper we address this question by a direct comparison of the information per symbol conveyed by the words coming from a binary Markov source (temporal code) with the information per symbol coming from the corresponding Bernoulli source (uncorrelated, rate code). In a previous paper we found that a crucial role in the relation between information transmission rates (ITRs) and firing rates is played by a parameter s, which is the sum of transition probabilities from the no-spike state to the spike state and vice versa. We found that in this case too a crucial role is played by the same parameter s. We calculated the maximal and minimal bounds of the quotient of ITRs for these sources. Next, making use of the entropy grouping axiom, we determined the loss of information in a Markov source compared with the information in the corresponding Bernoulli source for a given word length. Our results show that in the case of correlated signals the loss of information is relatively small, and thus temporal codes, which are more energetically efficient, can replace rate codes effectively. These results were confirmed by experiments.

Explicit mutual information for simple networks and neurons with lognormal activities

Explicit mutual information for simple networks and neurons with lognormal activities

Exact minimax entropy models of large-scale neuronal activity

Applications of information geometry to spiking neural network activity

Alternating Shrinking Higher-order Interactions for Sparse Neural Population Activity

Quantifying information stored in synaptic connections rather than in firing patterns of neural networks

Emergence of Irregular Activity in Networks of Strongly Coupled Conductance-Based Neurons

Probabilistic models, compressible interactions, and neural coding

Identifying Effective Connectivity between Stochastic Neurons with Variable-Length Memory Using a Transfer Entropy Rate Estimator

Mutual information for the sparse stochastic block model

Rich dynamics caused by known biological brain network features resulting in stateful networks

Logarithmic distributions prove that intrinsic learning is Hebbian

A Graph Theoretic Interpretation of Neural Complexity

How Far can Neural Correlations Reduce Uncertainty? Comparison of Information Transmission Rates for Markov and Bernoulli Processes

Non-exchangeable networks of integrate-and-fire neurons: spatially-extended mean-field limit of the empirical measure

Efficiency characterization of a large neuronal network: a causal information approach

The determining role of covariances in large networks of stochastic neurons

Statistical mechanics for networks of real neurons

Network algorithmics and the emergence of the cortical synaptic-weight distribution

Long-Tailed Characteristic of Spiking Pattern Alternation Induced by Log-Normal Excitatory Synaptic Distribution

Mean-field theory of a plastic network of integrate-and-fire neurons