Abstract:With the advent of artificial intelligence (AI) based systems, a new era has begun. Decisions that were once made by humans are now increasingly being made by these advanced systems, with the inevitable consequence of our growing reliance on AI in many aspects of our lives. At the same time, the opaque nature of AI-based systems and the possibility of unintentional or hidden discriminatory practices and biases raises profound questions not only about the mechanics of AI, but also about how users perceive the fairness of these systems. We hypothesize that providing various explanations for AI decision-making processes and output may enhance users' fairness perceptions and make them trust the system and adopt its decisions. Hence, we devised an online between-subject experiment that explores users' fairness and comprehension perceptions of AI systems with respect to the explanations provided by the system, employing a case study of a managerial decision in the human resources (HR) domain. We manipulated (i) the decision-maker (AI or human); (ii) the input (candidate characteristics); (iii) the output (recommendation valence), and (iv) the explanation style. We examined the effect of the various manipulations (and individuals' demographic and personality characteristics) using multivariate ordinal regression. We also performed a multi-level analysis of experiment components to examine the effects of the decision-maker type, explanation style, and their combination. The results suggest three main conclusions. The first conclusion is that there is a gap in users' fairness and comprehension perception of AI-based decision making systems compared to human decision making. The second conclusion is that knowing that an AI-based system provided the decisions negatively affects users' fairness and comprehension perceptions, compared to knowing that humans made the decision. Finally, the third conclusion is that providing case-based, certification-based, or sensitivity-based explanations can narrow this gap and may even eliminate it. Additionally, we found that users' fairness and comprehension perceptions are influenced by a variety of factors such as the input, output, and explanation provided by the system, as well as by individuals' age, education, computer skills, and personality. Our findings may help to understand when and how to use explanations to improve users' perceptions regarding AI-based decision-making. CCS CONCEPTS • Human computer interaction (HCI) → HCI design and evaluation methods → User studies • Human-centered computing → Human computer interaction (HCI) → Empirical studies in HCI • Applied computing → Law, social and behavioral sciences → Sociology

In AI we trust? Perceptions about automated decision-making by artificial intelligence

User Perceptions of Algorithmic Decisions in the Personalized AI System:Perceptual Evaluation of Fairness, Accountability, Transparency, and Explainability

Application of artificial intelligence: risk perception and trust in the work context with different impact levels and task types

For Me or Against Me? Reactions to AI (vs. Human) Decisions That Are Favorable or Unfavorable to the Self and the Role of Fairness Perception

Decision-making in organizations: should managers use AI?

Perceptions and Acceptance of Artificial Intelligence: A Multi-Dimensional Study

"The Human Must Remain the Central Focus": Subjective Fairness Perceptions in Automated Decision-Making

Algorithms in the court: does it matter which part of the judicial decision-making is automated?

AI Decision Making with Dignity? Contrasting Workers’ Justice Perceptions of Human and AI Decision Making in a Human Resource Management Context

In AI We Trust? Factors That Influence Trustworthiness of AI-infused Decision-Making Processes

Bending the Automation Bias Curve: A Study of Human and AI-based Decision Making in National Security Contexts

Applied artificial intelligence and trust—The case of autonomous vehicles and medical assistance devices

Automated journalism: The effects of AI authorship and evaluative information on the perception of a science journalism article

AI-Ethics by Design. Evaluating Public Perception on the Importance of Ethical Design Principles of AI

The propensity to trust in automated technology mediates the links between technology self-efficacy and fear and acceptance of artificial intelligence

What Motivates People to Trust 'AI' Systems?

Does AI help humans make better decisions? A statistical evaluation framework for experimental and observational studies

Misalignments in AI Perception: Quantitative Findings and Visual Mapping of How Experts and the Public Differ in Expectations and Risks, Benefits, and Value Judgments

Exploring the artificial intelligence "Trust paradox": Evidence from a survey experiment in the United States

Who Made That Decision and Why? Users' Perceptions of Human Versus AI Decision-Making and the Power of Explainable-AI

What does the public think about artificial intelligence?—A criticality map to understand bias in the public perception of AI