Abstract:In recent years, information theory has come into the focus of researchers interested in the sensorimotor dynamics of both robots and living beings. One root for these approaches is the idea that living beings are information processing systems and that the optimization of these processes should be an evolutionary advantage. Apart from these more fundamental questions, there is much interest recently in the question how a robot can be equipped with an internal drive for innovation or curiosity that may serve as a drive for an open-ended, self-determined development of the robot. The success of these approaches depends essentially on the choice of a convenient measure for the information. This article studies in some detail the use of the predictive information (PI), also called excess entropy or effective measure complexity, of the sensorimotor process. The PI of a process quantifies the total information of past experience that can be used for predicting future events. However, the application of information theoretic measures in robotics mostly is restricted to the case of a finite, discrete state-action space. This article aims at applying the PI in the dynamical systems approach to robot control. We study linear systems as a first step and derive exact results for the PI together with explicit learning rules for the parameters of the controller. Interestingly, these learning rules are of Hebbian nature and local in the sense that the synaptic update is given by the product of activities available directly at the pertinent synaptic ports. The general findings are exemplified by a number of case studies. In particular, in a two-dimensional system, designed at mimicking embodied systems with latent oscillatory locomotion patterns, it is shown that maximizing the PI means to recognize and amplify the latent modes of the robotic system. This and many other examples show that the learning rules derived from the maximum PI principle are a versatile tool for the self-organization of behavior in complex robotic systems.

Information-theoretic description of a feedback-control Kuramoto model

Models of Strategic Decision-Making under Informational Control

Functional Control of Network Dynamical Systems: An Information Theoretic Approach

Information-theoretic approach to the study of control systems

Evolutionary Kuramoto Dynamics

On Information Transfer in Control Dynamical Systems

Stability and Synchronization of Kuramoto Oscillators

Intrinsic Motivation in Dynamical Control Systems

Foundations of Value of Information: A Semantic Metric for Networked Control Systems Tasks

Information-driven self-organization: the dynamical system approach to autonomous robot behavior

Isomorphism Properties of Optimality and Equilibrium Solutions under Equivalent Information Structure Transformations I: Stochastic Dynamic Teams

Functional Dynamical Structures in Complex Systems: an Information-Theoretic Approach

Complexified Synchrony

Semantic information, autonomous agency and non-equilibrium statistical physics

Optimizing synchronization stability of the Kuramoto model in complex networks and power grids

An Algorithmic Information Calculus for Causal Discovery and Reprogramming Systems

On active information storage in input-driven systems

A Unified Paradigm of Organized Complexity and Semantic Information Theory

Quantifying dynamical high-order interdependencies from the O-information: an application to neural spiking dynamics

Semantic Information in a model of Resource Gathering Agents

Information content and optimization of self-organized developmental systems