Abstract:Neuronal spike patterns are the fundamental units of neural communication in the brain, which is still not fully understood. Entropy measures offer a quantitative framework to assess the variability and information content of these spike patterns. By quantifying the uncertainty and informational content of neuronal patterns, entropy measures provide insights into neural coding strategies, synaptic plasticity, network dynamics, and cognitive processes. Here, we review basic entropy metrics and then we provide examples of recent advancements in using entropy as a tool to improve our understanding of neuronal processing. It focuses especially on studies on critical dynamics in neural networks and the relation of entropy to predictive coding and cortical communication. We highlight the necessity of expanding entropy measures from single neurons to encompass multi-neuronal activity patterns, as cortical circuits communicate through coordinated spatiotemporal activity patterns, called neuronal packets. We discuss how the sequential and partially stereotypical nature of neuronal packets influences the entropy of cortical communication. Stereotypy reduces entropy by enhancing reliability and predictability in neural signaling, while variability within packets increases entropy, allowing for greater information capacity. This balance between stereotypy and variability supports both robustness and flexibility in cortical information processing. We also review challenges in applying entropy to analyze such spatiotemporal neuronal spike patterns, notably, the "curse of dimensionality" in estimating entropy for high-dimensional neuronal data. Finally, we discuss strategies to overcome these challenges, including dimensionality reduction techniques, advanced entropy estimators, sparse coding schemes, and the integration of machine learning approaches. Thus, this work summarizes the most recent developments on how entropy measures contribute to our understanding of principles underlying neural coding.

Applications of information geometry to spiking neural network behavior

Applications of information geometry to spiking neural network activity

Applications of Discrete Mathematics for Understanding Dynamics of Synapses and Networks in Neuroscience

The geometry of spontaneous spiking in neuronal networks

Neural population geometry: An approach for understanding biological and artificial neural networks

Entropy of Neuronal Spike Patterns

Bifurcation and chaos in the spontaneously firing spike train of cultured neuronal network

The vitals for steady nucleation maps of spontaneous spiking coherence in autonomous two-dimensional neuronal networks

Entropy and information in neural spike trains: Progress on the sampling problem

Spatiotemporal Patterns in Neurobiology: An Overview for Future Artificial Intelligence

Geometry of population activity in spiking networks with low-rank structure

Bifurcation And Chaos In The Spontaneously Firing Spike Train Of Cultured Neuronal Network - Art. No. 68550e

Estimating and Analyzing Neural Information Flow Using Signal Processing on Graphs

Neural spikes as rare events

Spike Train SIMilarity Space (SSIMS): A Framework for Single Neuron and Ensemble Data Analysis

The Computational Structure of Spike Trains

Information Fragmentation, Encryption and Information Flow in Complex Biological Networks

Synchronized chaos in local cortical circuits

Probabilistic models, compressible interactions, and neural coding

Searching for collective behavior in a network of real neurons

Information Processing by Neuron Populations in the Central Nervous System: Mathematical Structure of Data and Operations