Abstract:Many experiments have suggested that the brain operates close to a critical state, based on signatures of criticality such as power-law distributed neuronal avalanches. In neural network models, criticality is a dynamical state that maximizes information processing capacities, e.g. sensitivity to input, dynamical range and storage capacity, which makes it a favorable candidate state for brain function. Although models that self-organize towards a critical state have been proposed, the relation between criticality signatures and learning is still unclear. Here, we investigate signatures of criticality in a self-organizing recurrent neural network (SORN). Investigating criticality in the SORN is of particular interest because it has not been developed to show criticality. Instead, the SORN has been shown to exhibit spatio-temporal pattern learning through a combination of neural plasticity mechanisms and it reproduces a number of biological findings on neural variability and the statistics and fluctuations of synaptic efficacies. We show that, after a transient, the SORN spontaneously self-organizes into a dynamical state that shows criticality signatures comparable to those found in experiments. The plasticity mechanisms are necessary to attain that dynamical state, but not to maintain it. Furthermore, onset of external input transiently changes the slope of the avalanche distributions - matching recent experimental findings. Interestingly, the membrane noise level necessary for the occurrence of the criticality signatures reduces the model's performance in simple learning tasks. Overall, our work shows that the biologically inspired plasticity and homeostasis mechanisms responsible for the SORN's spatio-temporal learning abilities can give rise to criticality signatures in its activity when driven by random input, but these break down under the structured input of short repeating sequences.

Biological Modelling of a Computational Spiking Neural Network with Neuronal Avalanches.

A General Description of Criticality in Neural Network Models

A dynamic neural network model of self-organized criticality in neuronal avalanches

Critical neural networks with short and long term plasticity

Computational Modeling of Neuronal Networks

The Critical Dynamics in Neural Network Improve the Computational Capability of Liquid State Machines.

A Simple Probabilistic Spiking Neuron Model with Hebbian Learning Rules.

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

Two-compartment neuronal spiking model expressing brain-state specific apical-amplification, -isolation and -drive regimes

Effects Investigation of Critical Spiking Neuronal Feature on Dendritic Credit Assignment for Efficient Spike-based Learning

Computational Modeling of Spiking Neural Network with Learning Rules from STDP and Intrinsic Plasticity

Learning Improvement of Spiking Neural Networks with Dynamic Adaptive Hyperparameter Neurons

Neuronal Avalanches of a Self-Organized Neural Network with Active-Neuron-dominant Structure.

Silicon Modeling of Spiking Neurons with Diverse Dynamic Behaviors

Liquid Computing of Spiking Neural Network with Multi-Clustered and Active-Neuron-dominant Structure.

Advanced Computing and Related Applications Leveraging Brain-inspired Spiking Neural Networks

Hopf Bifurcation In Mean Field Explains Critical Avalanches In Excitation-Inhibition Balanced Neuronal Networks: A Mechanism For Multiscale Variability

Understanding the Functional Roles of Modelling Components in Spiking Neural Networks

Phase transitions and self-organized criticality in networks of stochastic spiking neurons

Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network