Abstract:The deformable and continuum nature of soft robots promises versatility and adaptability. However, control of modular, multi-limbed soft robots for terrestrial locomotion is challenging due to the complex robot structure, actuator mechanics and robot-environment interaction. Traditionally, soft robot control is performed by modeling kinematics using exact geometric equations and finite element analysis. The research presents an alternative, model-free, data-driven, reinforcement learning inspired approach, for controlling multi-limbed soft material robots. This control approach can be summarized as a four-step process of discretization, visualization, learning and optimization. The first step involves identification and subsequent discretization of key factors that dominate robot-environment, in turn, the robot control. Graph theory is used to visualize relationships and transitions between the discretized states. The graph representation facilitates mathematical definition of periodic control patterns (simple cycles) and locomotion gaits. Rewards corresponding to individual arcs of the graph are weighted displacement and orientation change for robot state-to-state transitions. These rewards are specific to surface of locomotion and are learned. Finally, the control patterns result from optimization of reward dependent locomotion task (e.g. translation) cost function. The optimization problem is an Integer Linear Programming problem which can be quickly solved using standard solvers. The framework is generic and independent of type of actuator, soft material properties or the type of friction mechanism, as the control exists in the robot's task space. Furthermore, the data-driven nature of the framework imparts adaptability to the framework toward different locomotion surfaces by re-learning rewards.

Using First Principles for Deep Learning and Model-Based Control of Soft Robots

Motion Control Of A Soft Circular Crawling Robot Via Iterative Learning Control

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Control of soft robots with inertial dynamics

High-Precision Dynamic Control of Soft Robots with the Physics-Learning Hybrid Modeling Approach

Learning Dynamic Tasks on a Large-scale Soft Robot in a Handful of Trials

Model-free control framework for multi-limb soft robots

Review of Modeling and Control Methods of Soft Robots Based on Machine Learning

Physics-Guided Deep Learning Enabled Surrogate Modeling for Pneumatic Soft Robots

Learning-Based Control for Soft Robot–Environment Interaction with Force/Position Tracking Capability

Precise Control of Soft Robots Amidst Uncertain Environmental Contacts and Forces

Knowledge-based Neural Ordinary Differential Equations for Cosserat Rod-based Soft Robots

Learning Low-Dimensional Strain Models of Soft Robots by Looking at the Evolution of Their Shape with Application to Model-Based Control

Robust Learning-Based Control for Uncertain Nonlinear Systems With Validation on a Soft Robot

Offline Reinforcement Learning of Robotic Control Using Deep Kinematics and Dynamics

Soft Robots Learn to Crawl: Jointly Optimizing Design and Control with Sim-to-Real Transfer

A Modeling and Data-Driven Control Framework for Rigid-Soft Hybrid Robot with Visual Servoing

Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators

Visuo-dynamic self-modelling of soft robotic systems

Learning Reduced-Order Soft Robot Controller

Reinforcement Learning Controllers for Soft Robots using Learned Environments