Abstract:The deformable and continuum nature of soft robots promises versatility and adaptability. However, control of modular, multi-limbed soft robots for terrestrial locomotion is challenging due to the complex robot structure, actuator mechanics and robot-environment interaction. Traditionally, soft robot control is performed by modeling kinematics using exact geometric equations and finite element analysis. The research presents an alternative, model-free, data-driven, reinforcement learning inspired approach, for controlling multi-limbed soft material robots. This control approach can be summarized as a four-step process of discretization, visualization, learning and optimization. The first step involves identification and subsequent discretization of key factors that dominate robot-environment, in turn, the robot control. Graph theory is used to visualize relationships and transitions between the discretized states. The graph representation facilitates mathematical definition of periodic control patterns (simple cycles) and locomotion gaits. Rewards corresponding to individual arcs of the graph are weighted displacement and orientation change for robot state-to-state transitions. These rewards are specific to surface of locomotion and are learned. Finally, the control patterns result from optimization of reward dependent locomotion task (e.g. translation) cost function. The optimization problem is an Integer Linear Programming problem which can be quickly solved using standard solvers. The framework is generic and independent of type of actuator, soft material properties or the type of friction mechanism, as the control exists in the robot's task space. Furthermore, the data-driven nature of the framework imparts adaptability to the framework toward different locomotion surfaces by re-learning rewards.

Environment-Centric Learning Approach for Gait Synthesis in Terrestrial Soft Robots

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Model-free control framework for multi-limb soft robots

Learning Flexible and Reusable Locomotion Primitives for a Microrobot

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Synthesizing the optimal gait of a quadruped robot with soft actuators using deep reinforcement learning

Gait Learning for Soft Microrobots Controlled by Light Fields

Optimal Gait Control for a Tendon-driven Soft Quadruped Robot by Model-based Reinforcement Learning

Automated Gait Generation For Walking, Soft Robotic Quadrupeds

Learning to enhance multi-legged robot on rugged landscapes

Learning Generic and Dynamic Locomotion of Humanoids Across Discrete Terrains

Learning Multiple Gaits within Latent Space for Quadruped Robots

Adaptive Gait Modeling and Optimization for Principally Kinematic Systems

Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

Optimal Gait Design for a Soft Quadruped Robot via Multi-fidelity Bayesian Optimization

Distal Learning Applied to Biped Robots

Walking motion generation, synthesis, and control for biped robot by using PGRL, LPI, and fuzzy logic

Gaitor: Learning a Unified Representation Across Gaits for Real-World Quadruped Locomotion

Shared Autonomy Locomotion Synthesis With a Virtual Powered Prosthetic Ankle

Learning to Exploit Elastic Actuators for Quadruped Locomotion