Enhancing Job Interview Preparation Through Immersive Experiences Using Photorealistic, AI-powered Metahuman Avatars

Navid Ashrafi,Francesco Vona,Carina Ringsdorf,Christian Hertel,Luca Toni,Sarina Kailer,Alice Bartels,Tanja Kojic,Jan-Niklas Voigt-Antons

2024-10-07

Abstract:This study will investigate the user experience while interacting with highly photorealistic virtual job interviewer avatars in Virtual Reality (VR), Augmented Reality (AR), and on a 2D screen. Having a precise speech recognition mechanism, our virtual character performs a mock-up software engineering job interview to adequately immerse the user in a life-like scenario. To evaluate the efficiency of our system, we measure factors such as the provoked level of anxiety, social presence, self-esteem, and intrinsic motivation. This research is a work in progress with a prospective within-subject user study including approximately 40 participants. All users will engage with three job interview conditions (VR, AR, and desktop) and provide their feedback. Additionally, users' bio-physical responses will be collected using a biosensor to measure the level of anxiety during the job interview.

Human-Computer Interaction

What problem does this paper attempt to address?

The problem this paper attempts to address is enhancing the effectiveness of job interview preparation through the use of highly realistic, AI-driven virtual human (Metahuman) avatars in virtual reality (VR), augmented reality (AR), and 2D screen environments. Specifically, the study aims to improve users' interview preparation levels through these immersive experiences, particularly for software engineering job interviews. The research focuses on whether these technologies can effectively induce users' anxiety, social presence, self-esteem, and intrinsic motivation in simulated real interview scenarios, thereby helping users better prepare for actual interviews.

To evaluate the system's effectiveness, the researchers designed a within-subject study involving approximately 40 participants, who will experience three different interview conditions (VR, AR, and desktop) and provide feedback under each condition. Additionally, participants' physiological response data will be collected through biosensors to measure their anxiety levels during the interview process. The main hypotheses of the study include: virtual environments (AR and VR) will lead to higher anxiety and social presence compared to desktop environments; anxiety and social presence will be higher in VR environments than in AR environments; virtual environments (AR and VR) will significantly enhance intrinsic motivation and self-esteem compared to desktop environments, and the effects in AR environments may be more pronounced than in VR environments.