Abstract:The human ability to learn, generalize, and control complex manipulation tasks through multi-modality feedback suggests a unique capability, which we refer to as dexterity intelligence. Understanding and assessing this intelligence is a complex task. Amidst the swift progress and extensive proliferation of large language models (LLMs), their applications in the field of robotics have garnered increasing attention. LLMs possess the ability to process and generate natural language, facilitating efficient interaction and collaboration with robots. Researchers and engineers in the field of robotics have recognized the immense potential of LLMs in enhancing robot intelligence, human-robot interaction, and autonomy. Therefore, this comprehensive review aims to summarize the applications of LLMs in robotics, delving into their impact and contributions to key areas such as robot control, perception, decision-making, and path planning. We first provide an overview of the background and development of LLMs for robotics, followed by a description of the benefits of LLMs for robotics and recent advancements in robotics models based on LLMs. We then delve into the various techniques used in the model, including those employed in perception, decision-making, control, and interaction. Finally, we explore the applications of LLMs in robotics and some potential challenges they may face in the near future. Embodied intelligence is the future of intelligent science, and LLMs-based robotics is one of the promising but challenging paths to achieve this.

Leveraging Large Language Models for Comprehensive Locomotion Control in Humanoid Robots Design

Long-horizon Locomotion and Manipulation on a Quadrupedal Robot with Large Language Models

Prompt, Plan, Perform: LLM-based Humanoid Control via Quantized Imitation Learning

Grounding Language Models in Autonomous Loco-manipulation Tasks

SRLM: Human-in-Loop Interactive Social Robot Navigation with Large Language Model and Deep Reinforcement Learning

Enhancing the LLM-Based Robot Manipulation Through Human-Robot Collaboration

Large Language Models for Robotics: A Survey

LaMI: Large Language Models for Multi-Modal Human-Robot Interaction

AnyBipe: An End-to-End Framework for Training and Deploying Bipedal Robots Guided by Large Language Models

Modeling and reinforcement learning-based locomotion control for a humanoid robot with kinematic loop closures

Large Language Models for Robotics: Opportunities, Challenges, and Perspectives

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction

LLM-Based Human-Robot Collaboration Framework for Manipulation Tasks

Fusing Dynamics and Reinforcement Learning for Control Strategy: Achieving Precise Gait and High Robustness in Humanoid Robot Locomotion*

Self-Refined Large Language Model as Automated Reward Function Designer for Deep Reinforcement Learning in Robotics

Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Model

Human-centric Reward Optimization for Reinforcement Learning-based Automated Driving using Large Language Models

Accelerating Reinforcement Learning of Robotic Manipulations via Feedback from Large Language Models

Large Language Models for Orchestrating Bimanual Robots

Hybrid LMC: Hybrid Learning and Model-based Control for Wheeled Humanoid Robot via Ensemble Deep Reinforcement Learning