Abstract:As humans, we can naturally break down a task into individual steps in our daily lives and we are able to provide feedback or dynamically adjust the plan when encountering obstacles. Similarly, our aim is to facilitate agents in comprehending and carrying out natural language instructions in a more efficient and cost-effective manner. For example, in Vision-Language Navigation (VLN) tasks, the agent needs to understand instructions such as "go to the table by the fridge". This understanding allows the agent to navigate to the table and infer that the destination is likely to be in the kitchen. The traditional VLN approach mainly involves training models using a large number of labeled datasets for task planning in unseen environments. However, manual labeling incurs a high cost for this approach. Considering that large language models (LLMs) already possess extensive commonsense knowledge during pre-training, some researchers have started using LLMs as decision modules in embodied tasks, although this approach shows the LLMs' reasoning ability to plan a logical sequence of subtasks based on global information. However, executing subtasks often encounters issues, such as obstacles that hinder progress and alterations in the state of the target object. Even one mistake can cause the subsequent tasks to fail, which makes it challenging to complete the instructions through a single plan. Therefore, we propose a new approach-C (Correction) and P (Planning) with M (Memory) I (Integration)-that centered on an LLM for embodied tasks. In more detail, the auxiliary modules of the CPMI facilitate dynamic planning by the LLM-centric planner. These modules provide the agent with memory and generalized experience mechanisms to fully utilize the LLM capabilities, allowing it to improve its performance during execution. Finally, the experimental results on public datasets demonstrate that we achieve the best performance in the few-shot scenario, improving the efficiency of the successive task while increasing the success rate.

Chain-of-Planned-Behaviour Workflow Elicits Few-Shot Mobility Generation in LLMs

Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation

Where Would I Go Next? Large Language Models as Human Mobility Predictors

Mobility-LLM: Learning Visiting Intentions and Travel Preferences from Human Mobility Data with Large Language Models

LIMP: Large Language Model Enhanced Intent-aware Mobility Prediction

LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

AgentMove: Predicting Human Mobility Anywhere Using Large Language Model based Agentic Framework

Exploring large language models for human mobility prediction under public events

Deep Activity Model: A Generative Approach for Human Mobility Pattern Synthesis

Leveraging Commonsense Knowledge from Large Language Models for Task and Motion Planning

Behavior Tree Generation using Large Language Models for Sequential Manipulation Planning with Human Instructions and Feedback

Long-horizon Locomotion and Manipulation on a Quadrupedal Robot with Large Language Models

Human Mobility Modeling with Limited Information via Large Language Models

Task and Motion Planning with Large Language Models for Object Rearrangement

From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems

Urban Mobility Assessment Using LLMs

Be More Real: Travel Diary Generation Using LLM Agents and Individual Profiles

LLM A: Human in the Loop Large Language Models Enabled A Search for Robotics

Leave It to Large Language Models! Correction and Planning with Memory Integration

STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making