Abstract:This paper outlines a methodological approach for designing adaptive agents driving themselves near points of criticality. Using a synthetic approach we construct a conceptual model that, instead of specifying mechanistic requirements to generate criticality, exploits the maintenance of an organizational structure capable of reproducing critical behavior. Our approach exploits the well-known principle of universality, which classifies critical phenomena inside a few universality classes of systems independently of their specific mechanisms or topologies. In particular, we implement an artificial embodied agent controlled by a neural network maintaining a correlation structure randomly sampled from a lattice Ising model at a critical point. We evaluate the agent in two classical reinforcement learning scenarios: the Mountain Car benchmark and the Acrobot double pendulum, finding that in both cases the neural controller reaches a point of criticality, which coincides with a transition point between two regimes of the agent's behaviour, maximizing the mutual information between neurons and sensorimotor patterns. Finally, we discuss the possible applications of this synthetic approach to the comprehension of deeper principles connected to the pervasive presence of criticality in biological and cognitive systems.

Algorithmic Mapping Criticality into Self Organized Criticality

Cellular automata and self-organized criticality

A Monte Carlo investigation of the critical behavior of Stavskaya's probabilistic cellular automaton

Criticality as It Could Be: organizational invariance as self-organized criticality in embodied agents

Some toy models of self-organized criticality in percolation

Self-organized criticality in evolutionary systems with local interaction

Self-organized criticality via stochastic partial differential equations

A Model of Blood Flow in a Circulation Network

Dynamical Criticality: Overview and Open Questions

Criticality in Simple Models of Evolution

Coexistence of critical phenomena: the concept of manifold multi-spectral criticality

Mechanisms of self-organized quasicriticality in neuronal networks models

Eigen microstates in self-organized criticality

Self-Organized Criticality in Nonconserved Systems.

Learning Criticality in an Embodied Boltzmann Machine

Eigenstates in the self-organised criticality

Homeostatic Criticality in Neuronal Networks

Emergent Criticality Through Adaptive Information Processing in Boolean Networks

Critical Behavior of the Quantum Contact Process in One Dimension.

The inactive-active phase transition in the noisy additive (exclusive-or) probabilistic cellular automaton

Criticality and the Onset of Ordering in the Standard Vicsek Model