Abstract:The integration of users and experts in machine learning is a widely studied topic in artificial intelligence literature. Similarly, human-computer interaction research extensively explores the factors that influence the acceptance of AI as a decision support system. In this experimental study, we investigate users' preferences regarding the integration of experts in the development of such systems and how this affects their reliance on these systems. Specifically, we focus on the process of feature selection -- an element that is gaining importance due to the growing demand for transparency in machine learning models. We differentiate between three feature selection methods: algorithm-based, expert-based, and a combined approach. In the first treatment, we analyze users' preferences for these methods. In the second treatment, we randomly assign users to one of the three methods and analyze whether the method affects advice reliance. Users prefer the combined method, followed by the expert-based and algorithm-based methods. However, the users in the second treatment rely equally on all methods. Thus, we find a remarkable difference between stated preferences and actual usage. Moreover, allowing the users to choose their preferred method had no effect, and the preferences and the extent of reliance were domain-specific. The findings underscore the importance of understanding cognitive processes in AI-supported decisions and the need for behavioral experiments in human-AI interactions.

Measuring preferences for algorithms — How willing are people to cede control to algorithms?

An Integrative Perspective on Algorithm Aversion and Appreciation in Decision-Making

People Prefer Moral Discretion to Algorithms: Algorithm Aversion Beyond Intransparency

On the (non-) reliance on algorithms—A decision-theoretic account

Ruled by robots: preference for algorithmic decision makers and perceptions of their choices

The ABC of algorithmic aversion: not agent, but benefits and control determine the acceptance of automated decision-making

A Simple Explanation Reconciles “Algorithm Aversion” and “Algorithm Appreciation”: Hypotheticals vs. Real Judgments

Overcoming Algorithm Aversion: A Comparison between Process and Outcome Control

Reputational Algorithm Aversion

Algorithm aversion? On the influence of advice accuracy on trust in algorithmic advice

Algorithm, Expert, or Both? Evaluating the Role of Feature Selection Methods on User Preferences and Reliance

Are algorithms always fair? The study on public preferences toward algorithmic decision‐making: A case study from the perspectives of decision scenarios and social roles

A systematic review of algorithm aversion in augmented decision making

The extent of algorithm aversion in decision-making situations with varying gravity

Task-Dependent Algorithm Aversion

Algorithms in selection decisions: Effective, but unappreciated

Who is the Expert? Reconciling Algorithm Aversion and Algorithm Appreciation in AI-Supported Decision Making

How to overcome algorithm aversion: Learning from mistakes

What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Design

Preference for human, not algorithm aversion

Explaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders