Understanding the Application of Utility Theory in Robotics and Artificial Intelligence: A Survey

Qin Yang,Rui Liu

2023-06-16

Abstract:As a unifying concept in economics, game theory, and operations research, even in the Robotics and AI field, the utility is used to evaluate the level of individual needs, preferences, and interests. Especially for decision-making and learning in multi-agent/robot systems (MAS/MRS), a suitable utility model can guide agents in choosing reasonable strategies to achieve their current needs and learning to cooperate and organize their behaviors, optimizing the system's utility, building stable and reliable relationships, and guaranteeing each group member's sustainable development, similar to the human society. Although these systems' complex, large-scale, and long-term behaviors are strongly determined by the fundamental characteristics of the underlying relationships, there has been less discussion on the theoretical aspects of mechanisms and the fields of applications in Robotics and AI. This paper introduces a utility-orient needs paradigm to describe and evaluate inter and outer relationships among agents' interactions. Then, we survey existing literature in relevant fields to support it and propose several promising research directions along with some open problems deemed necessary for further investigations.

Robotics,Artificial Intelligence,Multiagent Systems,Neural and Evolutionary Computing,Systems and Control

What problem does this paper attempt to address?

The paper primarily explores the application of utility theory in the fields of robotics and artificial intelligence, and proposes an integrated model based on a utility-oriented demand paradigm. The core objective of the paper is to understand how utility influences decision-making, learning processes, and cooperative behavior in multi-agent/robot systems (MAS/MRS).

### Problems the Paper Attempts to Address:

1. **Survey of Utility Theory Applications in Robotics and AI**: Firstly, the authors conducted a comprehensive literature review on the application of utility theory in these fields to understand how existing research utilizes utility to describe and evaluate the interaction relationships between different agents.

2. **Utility-Oriented Demand Paradigm**: A new paradigm based on utility-oriented demand is proposed, which considers the utility and demand relationships in single agents, multi-agent systems, and human-robot interaction (HRI). This paradigm aims to better understand how utility influences key aspects such as cooperation, trust-building, and task execution among agents.

3. **Future Research Directions**: Based on utility theory, the paper also identifies several open questions for future research, aiming to promote the development of more robust, reliable, and efficient robotic and AI systems, especially in the areas of multi-agent systems and human-robot interaction.

### Main Contributions:

- **Introduction of a New Paradigm**: A utility-oriented demand paradigm is proposed to describe and evaluate the internal and external relationships in agent interactions.
- **Literature Review**: A review of the literature supporting the proposed utility-oriented demand paradigm.
- **Future Research Questions**: Several future research directions are proposed based on utility theory, providing guidance for researchers to design better robotic and AI systems.

Through these contributions, the paper aims to advance the understanding and application of utility theory in the fields of robotics and artificial intelligence.