Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning

Zhaoyuan Gu,Junheng Li,Wenlan Shen,Wenhao Yu,Zhaoming Xie,Stephen McCrory,Xianyi Cheng,Abdulaziz Shamsah,Robert Griffin,C. Karen Liu,Abderrahmane Kheddar,Xue Bin Peng,Yuke Zhu,Guanya Shi,Quan Nguyen,Gordon Cheng,Huijun Gao,Ye Zhao

2025-01-04

Abstract:Humanoid robots have great potential to perform various human-level skills. These skills involve locomotion, manipulation, and cognitive capabilities. Driven by advances in machine learning and the strength of existing model-based approaches, these capabilities have progressed rapidly, but often separately. Therefore, a timely overview of current progress and future trends in this fast-evolving field is essential. This survey first summarizes the model-based planning and control that have been the backbone of humanoid robotics for the past three decades. We then explore emerging learning-based methods, with a focus on reinforcement learning and imitation learning that enhance the versatility of loco-manipulation skills. We examine the potential of integrating foundation models with humanoid embodiments, assessing the prospects for developing generalist humanoid agents. In addition, this survey covers emerging research for whole-body tactile sensing that unlocks new humanoid skills that involve physical interactions. The survey concludes with a discussion of the challenges and future trends.

Robotics

What problem does this paper attempt to address?

The problems that this paper attempts to solve are: how to realize and enhance the locomotion and manipulation abilities of humanoid robots in complex environments, enabling them to perform diverse and general - purpose tasks. Specifically, the paper focuses on the following aspects:

1. **Review of traditional planning and control methods**:
- Humanoid robots have relied on model - based planning and control methods as their core technologies in the past 30 years. These methods include contact planning, motion planning and control, and are usually formulated as optimal control problems (OCPs) and solved using off - the - shelf or custom - made numerical solvers.

2. **Emerging learning methods**:
- Human - machine interaction learning methods such as Reinforcement Learning (RL) and Imitation Learning (IL) are developing rapidly and showing impressive results. In particular, RL can discover new behavior patterns through trial and error, while IL can efficiently acquire skills from expert demonstrations.

3. **Application of Foundation Models (FMs)**:
- Foundation models trained on large - scale Internet data sets have the ability of open - world reasoning and multi - modal semantic understanding, which are very valuable for robots in complex physical environments that require long - term logically coherent task planning. FMs can also help understand human intentions rather than just replicating observed actions.

4. **Whole - body Tactile Sensing**:
- This emerging research field unlocks new humanoid skills involving physical interactions, allowing robots to sense complex environments through tactile perception and evaluate object properties such as roughness, texture and weight.

5. **Challenges and future trends**:
- The paper discusses the current challenges, such as computational efficiency, numerical stability, robustness and scalability issues in high - dimensional systems, and how to transfer learning achievements in simulations to the real world. In addition, it also explores future research directions and opportunities, especially in combining multiple perception methods to enhance the perception ability of humanoid robots and the flexibility in handling complex tasks.

In summary, this paper aims to provide a comprehensive perspective, covering the progress from traditional methods to the latest learning techniques, and pointing out what key obstacles still need to be overcome in order to achieve more flexible and general - purpose humanoid robots.