Abstract:In light of the widespread use of algorithmic (intelligent) systems across numerous domains, there is an increasing awareness about the need to explain their underlying decision-making process and resulting outcomes. Since oftentimes these systems are being considered as black boxes, adding explanations to their outcomes may contribute to the perception of their transparency and, as a result, increase users’ trust and fairness perception towards the system, regardless of its actual fairness, which can be measured using various fairness tests and measurements. Different explanation styles may have a different impact on users’ perception of fairness towards the system and on their understanding of the outcome of the system. Hence, there is a need to understand how various explanation styles may impact non-expert users’ perceptions of fairness and understanding of the system’s outcome. In this study we aimed at fulfilling this need. We performed a between-subject user study in order to examine the effect of various explanation styles on users’ fairness perception and understanding of the outcome. In the experiment we examined four known styles of textual explanations (case-based, demographic-based, input influence-based and sensitivity-based) along with a new style (certification-based) that reflect the results of an auditing process of the system. The results suggest that providing some kind of explanation contributes to users’ understanding of the outcome and that some explanation styles are more beneficial than others. Moreover, while explanations provided by the system are important and can indeed enhance users’ perception of fairness, their perception mainly depends on the outcome of the system. The results may shed light on one of the main problems in explainability of algorithmic systems, which is choosing the best explanation to promote users’ fairness perception towards a particular system, with respect to the outcome of the system. The contribution of this study is reflected in the new and realistic case study that was examined, in the creation and evaluation of a new explanation style that can be used as the link between the actual (computational) fairness of the system and users’ fairness perception and in the need of analyzing and evaluating explanations while taking into account the outcome of the system.

Effects of Explanations on Applicant Reactions: A meta-analytic review

The Effects of Organizational Accounts on Student Applicants' Reaction to Rejection Letters

The Effects of Regulatory Fit between Explanation Framing and Applicants' Regulatory Foci on Applicant Reaction.

Measuring the Impact of Explanation Bias: A Study of Natural Language Justifications for Recommender Systems

What Type of Explanation Do Rejected Job Applicants Want? Implications for Explainable AI

How can applicants' reactions to scholastic aptitude tests be improved? A closer look at specific and general tests

Algorithms in personnel selection, applicants' attributions about organizations' intents and organizational attractiveness: An experimental study

Allow Me to Explain: Benefits of Explaining Extend to Distal Academic Performance

Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgment

The Impact of Explanations on Fairness in Human-AI Decision-Making: Protected vs Proxy Features

Effects of Explanation Types on User Satisfaction and Performance in Human-agent Teams

Creating Healthy Friction: Determining Stakeholder Requirements of Job Recommendation Explanations

Appropriate Fairness Perceptions? On the Effectiveness of Explanations in Enabling People to Assess the Fairness of Automated Decision Systems

Paving the way for research in recruitment and selection: recent developments, challenges and future opportunities

On the Relationship Between Explanations, Fairness Perceptions, and Decisions

Research on Employee Recruitment: So Many Studies, So Many Remaining Questions

A Co-design Study for Multi-Stakeholder Job Recommender System Explanations

Fairness, explainability and in-between: understanding the impact of different explanation methods on non-expert users’ perceptions of fairness toward an algorithmic system

Whom do Explanations Serve? A Systematic Literature Survey of User Characteristics in Explainable Recommender Systems Evaluation

Confident Teacher, Confident Student? A Novel User Study Design for Investigating the Didactic Potential of Explanations and their Impact on Uncertainty

Explanations Can Reduce Overreliance on AI Systems During Decision-Making