Abstract:In recent years collaborative robots have become major market drivers in industry 5.0, which aims to incorporate them alongside humans in a wide array of settings ranging from welding to rehabilitation. Improving human-machine collaboration entails using computational algorithms that will save processing as well as communication cost. In this study we have constructed an agent that can choose when to cooperate using an optimal strategy. The agent was designed to operate in the context of divergent interest tacit coordination games in which communication between the players is not possible and the payoff is not symmetric. The agent's model was based on a behavioral model that can predict the probability of a player converging on prominent solutions with salient features (e.g., focal points) based on the player's Social Value Orientation (SVO) and the specific game features. The SVO theory pertains to the preferences of decision makers when allocating joint resources between themselves and another player in the context of behavioral game theory. The agent selected stochastically between one of two possible policies, a greedy or a cooperative policy, based on the probability of a player to converge on a focal point. The distribution of the number of points obtained by the autonomous agent incorporating the SVO in the model was better than the results obtained by the human players who played against each other (i.e., the distribution associated with the agent had a higher mean value). Moreover, the distribution of points gained by the agent was better than any of the separate strategies the agent could choose from, namely, always choosing a greedy or a focal point solution. To the best of our knowledge, this is the first attempt to construct an intelligent agent that maximizes its utility by incorporating the belief system of the player in the context of tacit bargaining. This reward-maximizing strategy selection process based on the SVO can also be potentially applied in other human-machine contexts, including multiagent systems.

Neural Payoff Machines: Predicting Fair and Stable Payoff Allocations Among Team Members

Shapley Q-Value: A Local Reward Approach to Solve Global Reward Games

Expert demonstrations guide reward decomposition for multi-agent cooperation

Collective eXplainable AI: Explaining Cooperative Strategies and Agent Contribution in Multiagent Reinforcement Learning with Shapley Values

Historical Payoff Promotes Cooperation in the Prisoner's Dilemma Game

Deep Neural Networks for Optimal Team Composition

Novel Payoff Calculation Resolves Social Dilemmas in Networks

Using a Stochastic Agent Model to Optimize Performance in Divergent Interest Tacit Coordination Games

Incentivising cooperation by rewarding the weakest member

Shapley Values-Powered Framework for Fair Reward Split in Content Produced by GenAI

Fair Multi-party Machine Learning -- a Game Theoretic approach

Equity Pay In Networked Teams

Towards a more efficient computation of individual attribute and policy contribution for post-hoc explanation of cooperative multi-agent systems using Myerson values

Sharing the Cost of Success: A Game for Evaluating and Learning Collaborative Multi-Agent Instruction Giving and Following Policies

Modeling the Centaur: Human-Machine Synergy in Sequential Decision Making

Cooperating with machines

Adaptive Value Decomposition with Greedy Marginal Contribution Computation for Cooperative Multi-Agent Reinforcement Learning

Grounded Predictions of Teamwork as a One-Shot Game: A Multiagent Multi-Armed Bandits Approach

Learning Fair Policies in Decentralized Cooperative Multi-Agent Reinforcement Learning