The Interaction Fidelity Model: A Taxonomy to Distinguish the Aspects of Fidelity in Virtual Reality

Michael Bonfert,Thomas Muender,Ryan P. McMahan,Frank Steinicke,Doug Bowman,Rainer Malaka,Tanja Döring

2024-02-26

Abstract:Fidelity describes how closely a replication resembles the original. It can be helpful to analyze how faithful interactions in virtual reality (VR) are to a reference interaction. In prior research, fidelity has been restricted to the simulation of reality - also called realism. Our definition includes other reference interactions, such as superpowers or fiction. Interaction fidelity is a multilayered concept. Unfortunately, different aspects of fidelity have either not been distinguished in scientific discourse or referred to with inconsistent terminology. Therefore, we present the Interaction Fidelity Model (IntFi Model). Based on the human-computer interaction loop, it systematically covers all stages of VR interactions. The conceptual model establishes a clear structure and precise definitions of eight distinct components. It was reviewed through interviews with fourteen VR experts. We provide guidelines, diverse examples, and educational material to universally apply the IntFi Model to any VR experience. We identify common patterns and propose foundational research opportunities.

Multimedia,Human-Computer Interaction,Graphics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the inconsistent terminology and ambiguous definitions of the concept of interaction fidelity in virtual reality (VR) in scientific literature. Specifically, the author points out that although terms such as "fidelity", "sense of reality" and "naturalness" are often used to describe the degree of authenticity of VR interactions, these terms are used very casually in different studies without clear definitions or consistent terminology. This confusion makes it difficult to compare and synthesize research results, limiting a deeper understanding and application of VR interaction fidelity.

To address this challenge, the author proposes a conceptual framework named "Interaction Fidelity Model (IntFi Model)". This model aims to distinguish and define different aspects of fidelity by systematically covering all stages of VR interactions, from user input to system processing and then to the output of user experience. The IntFi Model is based on the human - computer interaction (HCI) cycle and extends a framework previously proposed by McMahan et al., dividing the interaction process into eight distinct fidelity components: (i) Action Fidelity, (ii) Detection Fidelity, (iii) Transfer Fidelity, (iv) Simulation Fidelity, (v) Rendering Fidelity, (vi) Display Fidelity, (vii) Perceptual Fidelity, and (viii) Experiential Fidelity.

By providing a comprehensive and consistent model, the IntFi Model not only helps to clarify the confusion in existing literature, but also provides a theoretical basis for future VR research, guiding how to design experiments, evaluate various factors of interaction fidelity, and understand the interdependencies between these factors. In addition, the model emphasizes the importance of considering the two - way interaction between the user and the system when evaluating VR interaction fidelity, which is helpful for developing more realistic and effective virtual experiences.