Abstract:It has been hypothesized that the brain optimizes its capacity for computation by self-organizing to a critical point. The dynamical state of criticality is achieved by striking a balance such that activity can effectively spread through the network without overwhelming it and is commonly identified in neuronal networks by observing the behavior of cascades of network activity termed “neuronal avalanches.” The dynamic activity that occurs in neuronal networks is closely intertwined with how the elements of the network are connected and how they influence each other's functional activity. In this review, we highlight how studying criticality with a broad perspective that integrates concepts from physics, experimental and theoretical neuroscience, and computer science can provide a greater understanding of the mechanisms that drive networks to criticality and how their disruption may manifest in different disorders. First, integrating graph theory into experimental studies on criticality, as is becoming more common in theoretical and modeling studies, would provide insight into the kinds of network structures that support criticality in networks of biological neurons. Furthermore, plasticity mechanisms play a crucial role in shaping these neural structures, both in terms of homeostatic maintenance and learning. Both network structures and plasticity have been studied fairly extensively in theoretical models, but much work remains to bridge the gap between theoretical and experimental findings. Finally, information theoretical approaches can tie in more concrete evidence of a network's computational capabilities. Approaching neural dynamics with all these facets in mind has the potential to provide a greater understanding of what goes wrong in neural disorders. Criticality analysis therefore holds potential to identify disruptions to healthy dynamics, granted that robust methods and approaches are considered.

Criticality & Deep Learning I: Generally Weighted Nets

Deep Learning the Ising Model Near Criticality

A General Description of Criticality in Neural Network Models

Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networks

Unveiling the intrinsic dynamics of biological and artificial neural networks: from criticality to optimal representations

Critical Learning Periods Emerge Even in Deep Linear Networks

Critical excitation-inhibition balance in dense neural networks

Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network

Probing Criticality with Deep Learning in Relativistic Heavy-Ion Collisions

Neural criticality from effective latent variables

Critical Learning Periods in Deep Neural Networks

Universality Class of Machine Learning for Critical Phenomena

25 years of criticality in neuroscience -- established results, open controversies, novel concepts

Criticality, Connectivity, and Neural Disorder: A Multifaceted Approach to Neural Computation

Finding critical edges in networks through deep reinforcement learning

Criticality versus uniformity in deep neural networks

"All-or-none" dynamics and local-range dominated interaction leading to criticality in neural systems

Signatures of criticality in efficient coding networks

Emergent Criticality Through Adaptive Information Processing in Boolean Networks

A toy model for brain criticality: self-organized excitation/inhibition ratio and the role of network clustering