Abstract:Neuronal spike patterns are the fundamental units of neural communication in the brain, which is still not fully understood. Entropy measures offer a quantitative framework to assess the variability and information content of these spike patterns. By quantifying the uncertainty and informational content of neuronal patterns, entropy measures provide insights into neural coding strategies, synaptic plasticity, network dynamics, and cognitive processes. Here, we review basic entropy metrics and then we provide examples of recent advancements in using entropy as a tool to improve our understanding of neuronal processing. It focuses especially on studies on critical dynamics in neural networks and the relation of entropy to predictive coding and cortical communication. We highlight the necessity of expanding entropy measures from single neurons to encompass multi-neuronal activity patterns, as cortical circuits communicate through coordinated spatiotemporal activity patterns, called neuronal packets. We discuss how the sequential and partially stereotypical nature of neuronal packets influences the entropy of cortical communication. Stereotypy reduces entropy by enhancing reliability and predictability in neural signaling, while variability within packets increases entropy, allowing for greater information capacity. This balance between stereotypy and variability supports both robustness and flexibility in cortical information processing. We also review challenges in applying entropy to analyze such spatiotemporal neuronal spike patterns, notably, the "curse of dimensionality" in estimating entropy for high-dimensional neuronal data. Finally, we discuss strategies to overcome these challenges, including dimensionality reduction techniques, advanced entropy estimators, sparse coding schemes, and the integration of machine learning approaches. Thus, this work summarizes the most recent developments on how entropy measures contribute to our understanding of principles underlying neural coding.

Applications of information geometry to spiking neural network activity

Applications of information geometry to spiking neural network behavior

The geometry of spontaneous spiking in neuronal networks

Neural population geometry: An approach for understanding biological and artificial neural networks

Applications of Discrete Mathematics for Understanding Dynamics of Synapses and Networks in Neuroscience

Estimating and Analyzing Neural Information Flow Using Signal Processing on Graphs

Generalized activity equations for spiking neural network dynamics

The vitals for steady nucleation maps of spontaneous spiking coherence in autonomous two-dimensional neuronal networks

Geometry of population activity in spiking networks with low-rank structure

Entropy of Neuronal Spike Patterns

Bifurcation and chaos in the spontaneously firing spike train of cultured neuronal network

Neural spikes as rare events

Linking structure and activity in nonlinear spiking networks

Probabilistic models, compressible interactions, and neural coding

Spatiotemporal Patterns in Neurobiology: An Overview for Future Artificial Intelligence

Approximating Nonlinear Functions With Latent Boundaries in Low-Rank Excitatory-Inhibitory Spiking Networks

Bifurcation And Chaos In The Spontaneously Firing Spike Train Of Cultured Neuronal Network - Art. No. 68550e

Spatial representability of neuronal activity

Entropy and information in neural spike trains: Progress on the sampling problem

Synchronized chaos in local cortical circuits

Searching for collective behavior in a network of real neurons