Swift progress for robots over complex terrain

Chen Li,Feifei Qian
DOI: https://doi.org/10.1038/d41586-023-00710-0
2023-08-05
Abstract:A four-legged robot has learned to run on sand at faster pace than humans jog on solid ground. With low energy use and few failures, this rapid robot shows the value of combining data-driven learning with accurate yet simple models.
Robotics,Systems and Control,Biological Physics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to enable quadruped robots to achieve fast, stable and energy - efficient movement on complex terrains (especially sandy ground). Specifically, the authors hope that the robot can run on sandy ground at a faster speed than a human jogging on solid ground, and can adapt to different types of sandy ground conditions (such as dry - wet degree and compactness), thereby reducing the number of failures and energy consumption. ### Main problems 1. **Challenges of complex terrains**: - Granular materials such as sandy ground will flow and deform when subjected to force, causing the robot's feet to easily sink into it. - The physical properties of sandy ground (such as humidity and compactness) will affect its bearing capacity and recovery ability, increasing the difficulty of control. 2. **Limitations of existing methods**: - Traditional rule - based control methods are difficult to cope with such complex environmental changes. - Purely data - driven learning methods, although effective, have a large gap between simulation and reality, especially on complex terrains. ### Solutions To overcome these problems, the authors adopted the following three methods: 1. **Combination of reinforcement learning and privileged learning**: - Use reinforcement learning to train the robot to maximize speed, minimize failure rate and energy consumption. - Introduce privileged learning technology, and use the "teacher" robot in the simulation environment to guide the "student" robot in the real environment, so that it can quickly adapt to different sandy ground conditions. 2. **Bridge between simulation and reality**: - Use a sandy ground model with highly variable physical properties in the simulation to better reflect the diversity of nature. - This method helps the robot to maintain good performance when facing unknown or changing sandy ground conditions. 3. **Accurate and simple sandy ground reaction force model**: - Select and optimize a model that describes the reaction force exerted by the sandy ground on the robot's feet. - This model not only accurately captures the physical interaction between the sandy ground and the robot's feet, but is also simple enough to make the simulation process fast and efficient. Through these methods, the authors successfully enabled the robot to reach a maximum speed of 3 meters per second on sandy ground, demonstrating its excellent performance and robustness. This achievement lays the foundation for the future development of robots that can move freely on more complex terrains.