Abstract:With the accelerated development of robot technologies, control becomes one of the central themes of research. In traditional approaches, the controller, by its internal functionality, finds appropriate actions on the basis of specific objectives for the task at hand. While very successful in many applications, self-organized control schemes seem to be favored in large complex systems with unknown dynamics or which are difficult to model. Reasons are the expected scalability, robustness, and resilience of self-organizing systems. The paper presents a self-learning neurocontroller based on extrinsic differential plasticity introduced recently, applying it to an anthropomorphic musculoskeletal robot arm with attached objects of unknown physical dynamics. The central finding of the paper is the following effect: by the mere feedback through the internal dynamics of the object, the robot is learning to relate each of the objects with a very specific sensorimotor pattern. Specifically, an attached pendulum pilots the arm into a circular motion, a half-filled bottle produces axis oriented shaking behavior, a wheel is getting rotated, and wiping patterns emerge automatically in a table-plus-brush setting. By these object-specific dynamical patterns, the robot may be said to recognize the object's identity, or in other words, it discovers dynamical affordances of objects. Furthermore, when including hand coordinates obtained from a camera, a dedicated hand-eye coordination self-organizes spontaneously. These phenomena are discussed from a specific dynamical system perspective. Central is the dedicated working regime at the border to instability with its potentially infinite reservoir of (limit cycle) attractors "waiting" to be excited. Besides converging toward one of these attractors, variate behavior is also arising from a self-induced attractor morphing driven by the learning rule. We claim that experimental investigations with this anthropomorphic, self-learning robot not only generate interesting and potentially useful behaviors, but may also help to better understand what subjective human muscle feelings are, how they can be rooted in sensorimotor patterns, and how these concepts may feed back on robotics.

Local Online Motor Babbling: Learning Motor Abundance of a Musculoskeletal Robot Arm

Learning Inverse Statics Models Efficiently

Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robots

Motor learning in multijoint virtual arm movements with novel kinematics

A memory and attention-based reinforcement learning for musculoskeletal robots with prior knowledge of muscle synergies

Self-Organized Behavior Generation for Musculoskeletal Robots

Bioinspired Gain-Modulated Recurrent Neural Network for Controlling Musculoskeletal Robot

A Bio-Inspired Integration Model of Basal Ganglia and Cerebellum for Motion Learning of a Musculoskeletal Robot

GeMuCo: Generalized Multisensory Correlational Model for Body Schema Learning

Use of an artificial neuroadaptive robot model to describe adaptive and learning motor mechanisms in the central nervous system

Muscle-Synergies-Based Neuromuscular Control for Motion Learning and Generalization of a Musculoskeletal System

Musculoskeletal AutoEncoder: A Unified Online Acquisition Method of Intersensory Networks for State Estimation, Control, and Simulation of Musculoskeletal Humanoids

Effective Learning and Online Modulation for Robotic Variable Impedance Skills.

Learning Cooperative Dynamic Manipulation Skills from Human Demonstration Videos

Memory, Attention, and Muscle Synergies Based Reinforcement and Transfer Learning for Musculoskeletal Robots under Imperfect Observation

Demonstration Learning and Generalization of Robotic Motor Skills Based on Wearable Motion Tracking Sensors

Cerebellum-Inspired Learning and Control Scheme for Redundant Manipulators at Joint Velocity Level

Investigation of Motor Learning Effects Using a Hybrid Rehabilitation System Based on Motion Estimation

Hitting the Gym: Reinforcement Learning Control of Exercise-Strengthened Biohybrid Robots in Simulation

Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems

Socially Guided Intrinsic Motivation for Robot Learning of Motor Skills