"Hi. I'm Molly, Your Virtual Interviewer!" -- Exploring the Impact of Race and Gender in AI-powered Virtual Interview Experiences

Shreyan Biswas,Ji-Youn Jung,Abhishek Unnam,Kuldeep Yadav,Shreyansh Gupta,Ujwal Gadiraju
2024-08-26
Abstract:The persistent issue of human bias in recruitment processes poses a formidable challenge to achieving equitable hiring practices, particularly when influenced by demographic characteristics such as gender and race of both interviewers and candidates. Asynchronous Video Interviews (AVIs), powered by Artificial Intelligence (AI), have emerged as innovative tools aimed at streamlining the application screening process while potentially mitigating the impact of such biases. These AI-driven platforms present an opportunity to customize the demographic features of virtual interviewers to align with diverse applicant preferences, promising a more objective and fair evaluation. Despite their growing adoption, the implications of virtual interviewer identities on candidate experiences within AVIs remain underexplored. We aim to address this research and empirical gap in this paper. To this end, we carried out a comprehensive between-subjects study involving 218 participants across six distinct experimental conditions, manipulating the gender and skin color of an AI virtual interviewer agent. Our empirical analysis revealed that while the demographic attributes of the agents did not significantly influence the overall experience of interviewees, variations in the interviewees' demographics significantly altered their perception of the AVI process. Further, we uncovered that the mediating roles of Social Presence and Perception of the virtual interviewer critically affect interviewees' perceptions of fairness (+), privacy (-), and impression management (+).
Human-Computer Interaction
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to explore the impact of the identity characteristics (such as gender and race) of virtual interviewers on job - seekers' interview experiences in artificial - intelligence - based asynchronous video interviews (A VI). Specifically, the research aims to answer the following two research questions: 1. **How do the gender and race of virtual interviewers affect job - seekers' virtual interview experiences?** 2. **How do the job - seekers' gender and race affect their virtual interview experiences?** To answer these questions, the author conducted a comprehensive between - subjects experiment involving 218 participants. By manipulating the gender (female, male, non - binary gender) and skin color (black, white) of virtual interviewers, six different experimental conditions were designed. The research focuses on the following aspects: - **Perceived Fairness (PF)**: It measures job - seekers' views on the fairness of the interview process and methods, the fairness of organizational recruitment decisions, and the fairness of respect and informativeness in the interview. - **Social Perception and Presence (SPP)**: It assesses job - seekers' perceptions of the friendliness and competence of virtual interviewers, as well as their comfort and perception of social roles in the interview. - **Privacy and Emotional Response (PER)**: It measures job - seekers' concerns about privacy leakage, the risk of data abuse, and the discomfort, uneasiness, and fear they feel during the interview process. - **Impression Management (IM)**: It assesses the effectiveness of job - seekers in showing skills, knowledge, and non - verbal cues in the interview. The study found that although the gender and race characteristics of virtual interviewers did not significantly affect job - seekers' overall interview experiences, job - seekers' gender and race significantly affected their perceptions of the A VI process. In particular, black male and black female job - seekers scored higher in perceived fairness, social perception and social presence, and impression management, and these factors were significantly different from the experiences of white male and white female job - seekers. However, job - seekers' gender and race had no significant impact on the perception of privacy and emotional response. In addition, the study also explored the mediating role of social perception and social presence (SPP) in job - seekers' perceptions, especially the mediating effects in perceived fairness, privacy and emotional response, and impression management. For different groups of people, the mediating role of SPP varies. For example, for white female job - seekers, SPP significantly mediates their perception of fairness; while for black female job - seekers, SPP has no significant mediating role in privacy and emotional response and impression management. Overall, this study reveals how job - seekers' background characteristics affect their experiences in the A VI process and provides important insights for the future design of more fair and inclusive virtual interview systems.