Abstract:Robotic planning and execution in open-world environments is a complex problem due to the vast state spaces and high variability of task embodiment. Recent advances in perception algorithms, combined with Large Language Models (LLMs) for planning, offer promising solutions to these challenges, as the common sense reasoning capabilities of LLMs provide a strong heuristic for efficiently searching the action space. However, prior work fails to address the possibility of hallucinations from LLMs, which results in failures to execute the planned actions largely due to logical fallacies at high- or low-levels. To contend with automation failure due to such hallucinations, we introduce ConceptAgent, a natural language-driven robotic platform designed for task execution in unstructured environments. With a focus on scalability and reliability of LLM-based planning in complex state and action spaces, we present innovations designed to limit these shortcomings, including 1) Predicate Grounding to prevent and recover from infeasible actions, and 2) an embodied version of LLM-guided Monte Carlo Tree Search with self reflection. In simulation experiments, ConceptAgent achieved a 19% task completion rate across three room layouts and 30 easy level embodied tasks outperforming other state-of-the-art LLM-driven reasoning baselines that scored 10.26% and 8.11% on the same benchmark. Additionally, ablation studies on moderate to hard embodied tasks revealed a 20% increase in task completion from the baseline agent to the fully enhanced ConceptAgent, highlighting the individual and combined contributions of Predicate Grounding and LLM-guided Tree Search to enable more robust automation in complex state and action spaces.

Collaboration in Digital Games: an Approach to the Description Logic of Tasks

The Description Logic of Tasks: From Theory to Practice

Task Planning Based on the Description Logic of Tasks in Joint Operation Scenarios

Description Logics in Information Semantic Integration for Product Design and Manufacturing

Temporal Logic Task Planning for Autonomous Systems with Active Acquisition of Information

Enhancing Human-AI Collaboration Through Logic-Guided Reasoning

Collaborative Agents Supported Automatic Physical Database Design Based on Description Logics Reasoning

Towards Collaborative Plan Acquisition through Theory of Mind Modeling in Situated Dialogue

The Datalog(Dl) Combination Of Deduction Rules And Description Logics

Logic programming for deliberative robotic task planning

Coordinative Relationship Model for Groups Organization Based on the Description Logic of Tasks

Decentralized Motion Planning for Multiagent Collaboration under Coupled LTL Task Specifications

Dynamic Description Logic: Embracing Actions into Description Logic.

Synthesis of Distributed Control and Communication Schemes from Global LTL Specifications

Fast and Adaptive Multi-agent Planning under Collaborative Temporal Logic Tasks via Poset Products

Dynamic linear temporal extensions of description logics

Composing Semantic Web Services with Description Logics

Multi-Agent Path Planning for Finite Horizon Tasks with Counting Time Temporal Logics

ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution

Approach for Expanding Description Logic for Improving Role Description Ability

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation