Abstract:In traditional robotics, model-based controllers are usually needed in order to bring a robotic plant to the next desired state, but they present critical issues when the dimensionality of the control problem increases and disturbances from the external environment affect the system behavior, in particular during locomotion tasks. It is generally accepted that the motion control of quadruped animals is performed by neural circuits located in the spinal cord that act as a Central Pattern Generator and can generate appropriate locomotion patterns. This is thought to be the result of evolutionary processes that have optimized this network. On top of this, fine motor control is learned during the lifetime of the animal thanks to the plastic connections of the cerebellum that provide descending corrective inputs. This research aims at understanding and identifying the possible advantages of using learning during an evolution-inspired optimization for finding the best locomotion patterns in a robotic locomotion task. Accordingly, we propose a comparative study between two bio-inspired control architectures for quadruped legged robots where learning takes place either during the evolutionary search or only after that. The evolutionary process is carried out in a simulated environment, on a quadruped legged robot. To verify the possibility of overcoming the reality gap, the performance of both systems has been analyzed by changing the robot dynamics and its interaction with the external environment. Results show better performance metrics for the robotic agent whose locomotion method has been discovered by applying the adaptive module during the evolutionary exploration for the locomotion trajectories. Even when the motion dynamics and the interaction with the environment is altered, the locomotion patterns found on the learning robotic system are more stable, both in the joint and in the task space.

A comparison of controller architectures and learning mechanisms for arbitrary robot morphologies

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces

Gait-learning with morphologically evolving robots generated by L-system

A novel approach to locomotion learning: Actor-Critic architecture using central pattern generators and dynamic motor primitives

MorAL: Learning Morphologically Adaptive Locomotion Controller for Quadrupedal Robots on Challenging Terrains

Combining Evolutionary and Adaptive Control Strategies for Quadruped Robotic Locomotion

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

CPG-Based Hierarchical Locomotion Control for Modular Quadrupedal Robots Using Deep Reinforcement Learning.

Universal Morphology Control via Contextual Modulation

Learning-based Hierarchical Control: Emulating the Central Nervous System for Bio-Inspired Legged Robot Locomotion

Hierarchical Gait Generation for Modular Robots Using Deep Reinforcement Learning

Data-efficient Co-Adaptation of Morphology and Behaviour with Deep Reinforcement Learning

Learning plastic matching of robot dynamics in closed-loop central pattern generators

A Compositional Neuro-Controller for Advanced Motor Control Tasks

Reinforcement Learning of CPG-regulated Locomotion Controller for a Soft Snake Robot

Simultaneous Optimization of Discrete and Continuous Parameters Defining a Robot Morphology and Controller

Multi-embodiment Legged Robot Control As a Sequence Modeling Problem

Learning Locomotion Skills in Evolvable Robots

An Investigation of the Factors Influencing Evolutionary Dynamics in the Joint Evolution of Robot Body and Control

A model-free method to learn multiple skills in parallel on modular robots