Abstract:We introduce a lightweight LLM-based framework designed to enhance the autonomy and robustness of domestic robots, targeting onboard embodied intelligence. By addressing challenges such as kinematic constraints and dynamic environments, our approach reduces reliance on large-scale data and incorporates a robot-agnostic pipeline. Our framework, InteLiPlan, ensures that the LLM model's decision-making capabilities are effectively aligned with robotic functions, enhancing operational robustness and adaptability, while our human-in-the-loop mechanism allows for real-time human intervention in the case where the system fails. We evaluate our method in both simulation and on the real Toyota HSR robot. The results show that our method achieves a 93% success rate in the fetch me task completion with system failure recovery, outperforming the baseline method in a domestic environment. InteLiPlan achieves comparable performance to the state-of-the-art large-scale LLM-based robotics planner, while guaranteeing real-time onboard computing with embodied intelligence.

What problem does this paper attempt to address?

### Problems the paper attempts to solve The paper "InteLiPlan: Interactive Lightweight LLM - Based Planner for Domestic Robot Autonomy" aims to solve the problems of domestic robot autonomy and robustness. Specifically, the paper attempts to solve the following key problems: 1. **Reducing dependence on large - scale data**: - Traditional robot planning methods based on large language models (LLM) usually require a large amount of training data, which is unrealistic in practical applications because collecting such data is both time - consuming and expensive. InteLiPlan reduces the dependence on large - scale data by developing a lightweight framework. 2. **Coping with dynamic environments and motion constraints**: - Domestic robots will face changes in dynamic environments and their own motion constraints when performing tasks. The method proposed in the paper alleviates these constraints through real - time feasibility checks, ensuring that the decision - making process is effectively aligned with the physical capabilities of the robots. 3. **Enhancing human - machine interaction**: - In order to improve the autonomy and reliability of robots, the paper introduces a human - in - the - loop (HITL) mechanism. When the system fails, humans can perform real - time interventions and provide corrective measures, thereby enhancing the adaptability and robustness of the system. 4. **Achieving real - time embedded intelligence**: - The goal of the paper is to implement a lightweight LLM - based planner that can run in real - time on robots. This not only ensures the effective use of computing resources but also enables robots to run independently without network connections. 5. **Increasing the success rate of task completion**: - Through the above methods, the paper shows its high success rate in performing tasks (such as "fetching" tasks) in domestic environments and performs well in system failure recovery. ### Summary InteLiPlan solves the challenges of domestic robots in terms of autonomy, robustness, data efficiency, human - machine interaction, and real - time computing by developing a lightweight LLM - based planner framework. This framework not only improves the task completion rate of robots but also maintains high reliability and adaptability in complex environments.

InteLiPlan: Interactive Lightweight LLM-Based Planner for Domestic Robot Autonomy

Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Model

LLM-Personalize: Aligning LLM Planners with Human Preferences via Reinforced Self-Training for Housekeeping Robots

Grounding Language Models in Autonomous Loco-manipulation Tasks

Integrating Task-Motion Planning with Reinforcement Learning for Robust Decision Making in Mobile Robots

LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planning

SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models

Integrating Robot Task Planner with Common-sense Knowledge Base to Improve the Efficiency of Planning

ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planning

Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modeling

Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity

Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation

One to rule them all: natural language to bind communication, perception and action

Asynchronous Large Language Model Enhanced Planner for Autonomous Driving

LLM A: Human in the Loop Large Language Models Enabled A Search for Robotics

Prompt, Plan, Perform: LLM-based Humanoid Control via Quantized Imitation Learning

A Framework for Neurosymbolic Robot Action Planning using Large Language Models

Lifelong Robot Learning with Human Assisted Language Planners

Learning Enabled Fast Planning and Control in Dynamic Environments with Intermittent Information

Reactive Temporal Logic-based Planning and Control for Interactive Robotic Tasks