Predictors of the Sense of Presence in an Immersive Audio Storytelling Experience, a Mixed Methods Study. PREPRINT

Isabelle Verhulst,Rich Hemming,Adam Ganz,James Bennett,Rachel Donnelly,Dawn Watling,Polly Dalton

2024-06-10

Abstract:This study examined which variables predicted the sense of presence (being there) in an immersive audio experience, with a focus on the impacts of immersion technology (headphones with spatialised sound versus speaker with 2D stereo sound), the nature of the audio experience, the narrative content, participants emotional and cognitive engagement and personal characteristics such as age and gender. Museum visitors listened to a story on the One Story, Many Voices immersive audio installation. A convergent mixed-methods design was used, including multiple regression analysis of survey data (n 185) and relational analysis of interview data (n 9). This study found mixed methods support from both surveys and interviews to suggest that presence was predicted by the audio quality (especially the audio being perceived as different from other audio stories they had listened to in the past), cognitive engagement (especially being totally absorbed), the narrative (the story and how it was told) and some support was found for emotional engagement (especially feeling a connection with the storyteller). Effects of the environment and immersion technology on presence received only either quantitative or qualitative support. No influences of personal characteristics were found. Findings are relevant for academics, immersive experience (XR) commissioners and developers.

Human-Computer Interaction,Emerging Technologies

What problem does this paper attempt to address?

The problem this paper attempts to address is: which variables can predict people's "sense of presence" (i.e., the feeling of being "immersed") in immersive audio experiences. Specifically, the study focuses on the following factors:

1. **Technical Immersion**: The impact on the sense of presence when using headphones and spatial sound compared to using speakers and 2D stereo sound.
2. **Audio Quality**: Whether audio quality affects the sense of presence, particularly if listeners perceive this audio as different from other audio stories they have heard.
3. **Narrative Content**: Whether the content of the story and the way it is told affect the sense of presence.
4. **Emotional and Cognitive Engagement**: Whether the degree of emotional and cognitive engagement of participants affects the sense of presence.
5. **Personal Characteristics**: Whether personal characteristics such as age and gender affect the sense of presence.
6. **Environmental Factors**: The impact of the environment on the sense of presence.

The study employs a mixed-methods design, combining quantitative and qualitative data, aiming to comprehensively understand how these factors collectively influence the sense of presence in immersive audio experiences. This research is significant for academia, commissioners, and developers of immersive experiences (such as extended reality XR).