Abstract:Multi-hop question answering (MQA) is one of the challenging tasks to evaluate machine's comprehension and reasoning abilities, where large language models (LLMs) have widely achieved the human-comparable performance. Due to the dynamics of knowledge facts in real world, knowledge editing has been explored to update model with the up-to-date facts while avoiding expensive re-training or fine-tuning. Starting from the edited fact, the updated model needs to provide cascading changes in the chain of MQA. The previous art simply adopts a mix-up prompt to instruct LLMs conducting multiple reasoning tasks sequentially, including question decomposition, answer generation, and conflict checking via comparing with edited facts. However, the coupling of these functionally-diverse reasoning tasks inhibits LLMs' advantages in comprehending and answering questions while disturbing them with the unskilled task of conflict checking. We thus propose a framework, Programmable knowledge editing for Multi-hop Question Answering (PokeMQA), to decouple the jobs. Specifically, we prompt LLMs to decompose knowledge-augmented multi-hop question, while interacting with a detached trainable scope detector to modulate LLMs behavior depending on external conflict signal. The experiments on three LLM backbones and two benchmark datasets validate our superiority in knowledge editing of MQA, outperforming all competitors by a large margin in almost all settings and consistently producing reliable reasoning process.

Analysis of the KQML Model in Multi-Agent Interaction

Algebraic Method for Describing and Analyzing the Architecture of Mas Based Autonomous Mobile Robot

A SEMANTIC DESCRIPTION OF AN AGENT COMMUNICATION LANGUAGE

Evaluation Models and Multi-Agent Cooperation Strategies in CAUPS

Semantics and Conversations for an Agent Communication Language

Interactive strategy model of multi-agent system

KAOS: Large Model Multi-Agent Operating System

MA2QL: A Minimalist Approach to Fully Decentralized Multi-Agent Reinforcement Learning

PokeMQA: Programmable knowledge editing for Multi-hop Question Answering

A Dynamic Model of Multi-Agent System

Formalizing Interactions and Interaction Protocols in Multi-Agent Systems *

Partial Communication Model Based on the Gain of Q-value in Multi-agent Reinforcement Learning

AN AGENT FRAMEWORK BASED ON DISTRIBUTED OBJECT

Do We Really Need a Complex Agent System? Distill Embodied Agent into a Single Model

Multi-Agent Alternate Q-Learning.

Communication and the Multi-Agent System Framework of CMC for the Networked Manufacturing System

Multi-Agent Coordination via Multi-Level Communication

KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents

KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph

Organizational Models and Interaction Patterns for Use in the Analysis and Design of Multi-Agent Systems.

A new paradigm of modeling for military industrial logistics agent interaction protocol: Command interaction diagram