Abstract:With the accelerated development of robot technologies, control becomes one of the central themes of research. In traditional approaches, the controller, by its internal functionality, finds appropriate actions on the basis of specific objectives for the task at hand. While very successful in many applications, self-organized control schemes seem to be favored in large complex systems with unknown dynamics or which are difficult to model. Reasons are the expected scalability, robustness, and resilience of self-organizing systems. The paper presents a self-learning neurocontroller based on extrinsic differential plasticity introduced recently, applying it to an anthropomorphic musculoskeletal robot arm with attached objects of unknown physical dynamics. The central finding of the paper is the following effect: by the mere feedback through the internal dynamics of the object, the robot is learning to relate each of the objects with a very specific sensorimotor pattern. Specifically, an attached pendulum pilots the arm into a circular motion, a half-filled bottle produces axis oriented shaking behavior, a wheel is getting rotated, and wiping patterns emerge automatically in a table-plus-brush setting. By these object-specific dynamical patterns, the robot may be said to recognize the object's identity, or in other words, it discovers dynamical affordances of objects. Furthermore, when including hand coordinates obtained from a camera, a dedicated hand-eye coordination self-organizes spontaneously. These phenomena are discussed from a specific dynamical system perspective. Central is the dedicated working regime at the border to instability with its potentially infinite reservoir of (limit cycle) attractors "waiting" to be excited. Besides converging toward one of these attractors, variate behavior is also arising from a self-induced attractor morphing driven by the learning rule. We claim that experimental investigations with this anthropomorphic, self-learning robot not only generate interesting and potentially useful behaviors, but may also help to better understand what subjective human muscle feelings are, how they can be rooted in sensorimotor patterns, and how these concepts may feed back on robotics.

Self-organizing Continuous Attractor Networks and Motor Function

Self-organizing Continuous Attractor Networks and Path Integration: One-Dimensional Models of Head Direction Cells

Hierarchical Dynamical Models of Motor Function

Learning Movement Sequences with a Delayed Reward Signal in a Hierarchical Model of Motor Function.

Self-organizing Path Integration Using a Linked Continuous Attractor and Competitive Network: Path Integration of Head Direction.

Self-organising Continuous Attractor Networks with Multiple Activity Packets, and the Representation of Space

Self-organizing continuous attractor network models of hippocampal spatial view cells

Learning and Encoding Motor Primitives for Limb Actions in a Brain-Like Computation Approach.

Fast social-like learning of complex behaviors based on motor motifs

De Novo Sensorimotor Learning Through Reuse of Movement Components

Self-development of motor abilities resulting from the growth of a neural network reinforced by pleasure and tensions

Brain-like neural dynamics for behavioral control develop through reinforcement learning

Self-organized attractoring in locomoting animals and robots: an emerging field

Learning from Neural Control in Motor Systems.

From Data-Fitting to Discovery: Interpreting the Neural Dynamics of Motor Control through Reinforcement Learning

Self-Organized Behavior Generation for Musculoskeletal Robots

Self-configuring feedback loops for sensorimotor control

Human motor learning dynamics in high-dimensional tasks

A movement pattern generator model using artificial neural networks

Separated attractors in neural landscape of motor cortex encoding motor learning