Here's Charlie! Realising the Semantic Web vision of Agents in the age of LLMs

Jesse Wright
DOI: https://doi.org/10.48550/arXiv.2409.04465
2024-09-03
Abstract:This paper presents our research towards a near-term future in which legal entities, such as individuals and organisations can entrust semi-autonomous AI-driven agents to carry out online interactions on their behalf. The author's research concerns the development of semi-autonomous Web agents, which consult users if and only if the system does not have sufficient context or confidence to proceed working autonomously. This creates a user-agent dialogue that allows the user to teach the agent about the information sources they trust, their data-sharing preferences, and their decision-making preferences. Ultimately, this enables the user to maximise control over their data and decisions while retaining the convenience of using agents, including those driven by LLMs. In view of developing near-term solutions, the research seeks to answer the question: "How do we build a trustworthy and reliable network of semi-autonomous agents which represent individuals and organisations on the Web?". After identifying key requirements, the paper presents a demo for a sample use case of a generic personal assistant. This is implemented using (Notation3) rules to enforce safety guarantees around belief, data sharing and data usage and LLMs to allow natural language interaction with users and serendipitous dialogues between software agents.
Artificial Intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to construct a trustworthy and reliable semi - autonomous intelligent agent network to represent individuals and organizations for online interactions on the Web. Specifically, the research aims to answer the following question: **"How to construct a trustworthy and reliable semi - autonomous intelligent agent network so that these agents can represent individuals and organizations for online interactions on the Web?"** ### Background and Motivation of the Problem 1. **Realization of the Semantic Web Vision**: The vision of the Semantic Web is to automatically perform tasks in the network through intelligent agents, but this goal has not been achieved on a large scale yet. With the rise of large language models (LLMs), constructing trustworthy and reliable Web agents has become a new challenge. 2. **Trust and Reliability Issues**: With the development of LLMs, especially as the need to establish conversations among multiple LLMs increases, it becomes crucial to ensure that these agents are trustworthy and reliable when performing tasks. 3. **Data Privacy and Control**: Users need to be able to maintain maximum control over their own data and decisions while using agents and at the same time enjoy the convenience brought by the agents. ### Key Requirements for the Solution To achieve this goal, the paper proposes several key requirements: 1. **Entity Identification**: Agents must be able to identify legal entities (such as individuals or organizations) on the Web in order to interact with them. 2. **Deterministic Discovery of Other Agents**: Deterministically discover other agents representing an entity from the entity's Web identity. 3. **Describe and Agree on Data Use Control**: Clearly describe and agree on the use control related to shared data, ensuring that the legal or moral obligations of the recipient are clear when sharing protected data. 4. **Describe Data Source and Provenance**: Clearly describe the source and provenance of the exchanged data so that the system can identify the credibility of external claims according to the internal trust model. 5. **Unambiguously Describe Facts and Agreements**: Use formal notations to unambiguously describe the facts sent and the agreements reached, reducing the risk of misunderstandings and legal disputes. 6. **Contextualize Vague or Poorly - Defined Tasks**: In cases where tasks may be vague or poorly - defined, agents should be able to introduce new solution spaces or negotiate with participants. ### Example Use Cases and Implementations The paper shows how to achieve the above requirements through a specific use case. For example, in the process of arranging a meeting, agents use techniques such as natural language processing and Notation3 rule - based reasoning to ensure that the task is completed safely and reliably while respecting users' privacy and preferences. ### Conclusions and Future Research Directions Future research will further refine the design requirements, develop more specialized agents through user research and industry cooperation, formalize the vocabulary for exchanging provenance and use terms, and model the trust and data policies within agents. This will enable agents to believe in claims based on sufficient provenance and find mutually acceptable data use terms, while continuously updating their internal models through user interactions.