Abstract:In traditional robotics, model-based controllers are usually needed in order to bring a robotic plant to the next desired state, but they present critical issues when the dimensionality of the control problem increases and disturbances from the external environment affect the system behavior, in particular during locomotion tasks. It is generally accepted that the motion control of quadruped animals is performed by neural circuits located in the spinal cord that act as a Central Pattern Generator and can generate appropriate locomotion patterns. This is thought to be the result of evolutionary processes that have optimized this network. On top of this, fine motor control is learned during the lifetime of the animal thanks to the plastic connections of the cerebellum that provide descending corrective inputs. This research aims at understanding and identifying the possible advantages of using learning during an evolution-inspired optimization for finding the best locomotion patterns in a robotic locomotion task. Accordingly, we propose a comparative study between two bio-inspired control architectures for quadruped legged robots where learning takes place either during the evolutionary search or only after that. The evolutionary process is carried out in a simulated environment, on a quadruped legged robot. To verify the possibility of overcoming the reality gap, the performance of both systems has been analyzed by changing the robot dynamics and its interaction with the external environment. Results show better performance metrics for the robotic agent whose locomotion method has been discovered by applying the adaptive module during the evolutionary exploration for the locomotion trajectories. Even when the motion dynamics and the interaction with the environment is altered, the locomotion patterns found on the learning robotic system are more stable, both in the joint and in the task space.

Learning Locomotion Skills in Evolvable Robots

Gait-learning with morphologically evolving robots generated by L-system

Motion Control of Bionic Robots Via Biomimetic Learning

Generation Undulatory Locomotion of C. Elegans in A Crawling Robot Via Biomimetic Learning

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Learning and Adapting Agile Locomotion Skills by Transferring Experience

Evolution and learning in differentiable robots

Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces

Combining Evolutionary and Adaptive Control Strategies for Quadruped Robotic Locomotion

Learning Flexible and Reusable Locomotion Primitives for a Microrobot

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

A Comparative Study of Brain Reproduction Methods for Morphologically Evolving Robots

Learning Agile Locomotion Skills with a Mentor

A model-free method to learn multiple skills in parallel on modular robots

Morphological Development at the Evolutionary Timescale: Robotic Developmental Evolution

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

Lamarck's Revenge: Inheritance of Learned Traits Can Make Robot Evolution Better

Efficient and Diverse Generative Robot Designs using Evolution and Intrinsic Motivation

A comparison of controller architectures and learning mechanisms for arbitrary robot morphologies

Experience-Learning Inspired Two-Step Reward Method for Efficient Legged Locomotion Learning Towards Natural and Robust Gaits

A psychology based approach for longitudinal development in cognitive robotics