Abstract:With the accelerated development of robot technologies, control becomes one of the central themes of research. In traditional approaches, the controller, by its internal functionality, finds appropriate actions on the basis of specific objectives for the task at hand. While very successful in many applications, self-organized control schemes seem to be favored in large complex systems with unknown dynamics or which are difficult to model. Reasons are the expected scalability, robustness, and resilience of self-organizing systems. The paper presents a self-learning neurocontroller based on extrinsic differential plasticity introduced recently, applying it to an anthropomorphic musculoskeletal robot arm with attached objects of unknown physical dynamics. The central finding of the paper is the following effect: by the mere feedback through the internal dynamics of the object, the robot is learning to relate each of the objects with a very specific sensorimotor pattern. Specifically, an attached pendulum pilots the arm into a circular motion, a half-filled bottle produces axis oriented shaking behavior, a wheel is getting rotated, and wiping patterns emerge automatically in a table-plus-brush setting. By these object-specific dynamical patterns, the robot may be said to recognize the object's identity, or in other words, it discovers dynamical affordances of objects. Furthermore, when including hand coordinates obtained from a camera, a dedicated hand-eye coordination self-organizes spontaneously. These phenomena are discussed from a specific dynamical system perspective. Central is the dedicated working regime at the border to instability with its potentially infinite reservoir of (limit cycle) attractors "waiting" to be excited. Besides converging toward one of these attractors, variate behavior is also arising from a self-induced attractor morphing driven by the learning rule. We claim that experimental investigations with this anthropomorphic, self-learning robot not only generate interesting and potentially useful behaviors, but may also help to better understand what subjective human muscle feelings are, how they can be rooted in sensorimotor patterns, and how these concepts may feed back on robotics.

Self-Organized Behavior Generation for Musculoskeletal Robots

Self-organized control for musculoskeletal robots

Neural self-organization for muscle-driven robots

Self-organized attractoring in locomoting animals and robots: an emerging field

Learning body models: from humans to humanoids

Embodied robots driven by self-organized environmental feedback

Bioinspired Gain-Modulated Recurrent Neural Network for Controlling Musculoskeletal Robot

Hitting the Gym: Reinforcement Learning Control of Exercise-Strengthened Biohybrid Robots in Simulation

Learning plastic matching of robot dynamics in closed-loop central pattern generators

Learning to Control Emulated Muscles in Real Robots: Towards Exploiting Bio-Inspired Actuator Morphology

Muscle-Synergies-Based Neuromuscular Control for Motion Learning and Generalization of a Musculoskeletal System

Self-organized adaptation of a simple neural circuit enables complex robot behaviour

Hierarchical generative modelling for autonomous robots

Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems

Active exploration for body model learning through self-touch on a humanoid robot with artificial skin

Full-Body Visual Self-Modeling of Robot Morphologies

Self Model for Embodied Intelligence: Modeling Full-Body Human Musculoskeletal System and Locomotion Control with Hierarchical Low-Dimensional Representation

Hierarchical Control of Visually-Guided Movements in a 3D-Printed Robot Arm

Self-configuring feedback loops for sensorimotor control

Realizing Human-Like Manipulation with a Musculoskeletal System and Biologically Inspired Control Scheme

Long-time Self-body Image Acquisition and its Application to the Control of Musculoskeletal Structures