More Similar Values, More Trust? -- the Effect of Value Similarity on Trust in Human-Agent Interaction

Siddharth Mehrotra,Catholijn M. Jonker,Myrthe L. Tielman
DOI: https://doi.org/10.1145/3461702.3462576
2021-05-20
Abstract:As AI systems are increasingly involved in decision making, it also becomes important that they elicit appropriate levels of trust from their users. To achieve this, it is first important to understand which factors influence trust in AI. We identify that a research gap exists regarding the role of personal values in trust in AI. Therefore, this paper studies how human and agent Value Similarity (VS) influences a human's trust in that agent. To explore this, 89 participants teamed up with five different agents, which were designed with varying levels of value similarity to that of the participants. In a within-subjects, scenario-based experiment, agents gave suggestions on what to do when entering the building to save a hostage. We analyzed the agent's scores on subjective value similarity, trust and qualitative data from open-ended questions. Our results show that agents rated as having more similar values also scored higher on trust, indicating a positive effect between the two. With this result, we add to the existing understanding of human-agent trust by providing insight into the role of value-similarity.
Artificial Intelligence,Human-Computer Interaction
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to explore the trust issue between humans and intelligent agents (AI), especially how the similarity of personal values affects this trust. Specifically, the researchers are concerned with: 1. **Understanding the influencing factors of trust**: As AI systems are increasingly used in decision - making, it is crucial to ensure that users have appropriate trust in these systems. Therefore, it is necessary to understand which factors will influence users' trust in AI. 2. **Filling the research gap**: There are deficiencies in the existing research on the role of personal values in trust, especially regarding the impact of value similarity (VS) between humans and AI on trust. 3. **Experimental verification of hypotheses**: Design an experiment to verify the hypothesis that the more similar the values of humans and AI are, the higher the trust of humans in that AI. ### Research background and motivation - **The importance of trust**: Appropriate trust can ensure the effective use of AI systems and avoid negative consequences caused by over - trust or distrust. - **Multidimensional trust**: Trust is not only based on reliability and predictability, but also involves people's personal values, preferences, expectations and beliefs. - **The potential impact of value similarity**: Studies have shown that in human - to - human interactions, similar values can enhance trust. Therefore, researchers speculate that this phenomenon may also apply to human - AI interactions. ### Experimental design To verify the above hypothesis, the researchers designed an experiment in which 89 participants cooperated with five AI agents with different value - similarity configurations to complete a simulated task - rescuing hostages. Participants evaluated the trustworthiness of the agents based on the advice provided by the agents and answered questionnaires about subjective value similarity. ### Main findings - **Positive correlation between value similarity and trust**: The experimental results show that participants believe that agents more similar to their own values also received higher trust scores, indicating a significant positive correlation between the two. - **Analysis of the reasons for manipulation failure**: Although the experimental results support the main hypothesis, the researchers found that in some cases, the actually perceived value similarity did not fully meet the expected design. This may be due to the scenario settings or the participants' misunderstanding of the agents' explanations. ### Conclusions and future work - **Theoretical contributions**: This study provides a new perspective for understanding the trust mechanism in human - machine interaction, especially in considering personal values. - **Practical significance**: When designing AI systems, users' values and their importance in specific situations should be considered to promote the establishment of appropriate trust. - **Future directions**: Further study the impact of value similarity on trust in different cultural backgrounds, and how to better manipulate and measure the value expressions of agents. Through these efforts, researchers hope to provide valuable insights for building more trustworthy and human - like AI systems.