Abstract:In recent years, Augmented Reality (AR), Virtual Reality (VR), Augmented Virtuality (AV), and Mixed Reality (MxR) have become popular immersive reality technologies for cultural knowledge dissemination in Virtual Heritage (VH). These technologies have been utilized for enriching museums with a personalized visiting experience and digital content tailored to the historical and cultural context of the museums and heritage sites. Various interaction methods, such as sensor-based, device-based, tangible, collaborative, multimodal, and hybrid interaction methods, have also been employed by these immersive reality technologies to enable interaction with the virtual environments. However, the utilization of these technologies and interaction methods isn't often supported by a guideline that can assist Cultural Heritage Professionals (CHP) to predetermine their relevance to attain the intended objectives of the VH applications. In this regard, our paper attempts to compare the existing immersive reality technologies and interaction methods against their potential to enhance cultural learning in VH applications. To objectify the comparison, three factors have been borrowed from existing scholarly arguments in the Cultural Heritage (CH) domain. These factors are the technology's or the interaction method's potential and/or demonstrated capability to: (1) establish a contextual relationship between users, virtual content, and cultural context, (2) allow collaboration between users, and (3) enable engagement with the cultural context in the virtual environments and the virtual environment itself. Following the comparison, we have also proposed a specific integration of collaborative and multimodal interaction methods into a Mixed Reality (MxR) scenario that can be applied to VH applications that aim at enhancing cultural learning <i>in situ</i>.

A review on multimodal interaction in Mixed Reality Environment

Designing User Interaction using Gesture and Speech for Mixed Reality Interface

A Review of Multimodal Interaction

Multimodal interaction: A review

Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review

Interaction With Gaze, Gesture, and Speech in a Flexibly Configurable Augmented Reality System

Literature Review of Mixed Reality Research

Multimodal Systems: Taxonomy, Methods, and Challenges

Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction

Real-time multimodal interaction in virtual reality - a case study with a large virtual interface

Hand interaction designs in mixed and augmented reality head mounted display: a scoping review and classification

A review on ergonomics evaluations of virtual reality

Multimodality in VR: A survey

Evaluating Object Manipulation Interaction Techniques in Mixed Reality: Tangible User Interfaces and Gesture

Multimodal human-computer interaction for virtual reality

Multisensory Integration as per Technological Advances: A Review

Hands and speech in space: multimodal interaction with augmented reality interfaces

Mixed Reality Interaction Techniques

Recent advancements in multimodal human-robot interaction

A Comparison of Immersive Realities and Interaction Methods: Cultural Learning in Virtual Heritage

Progress and Prospects of Multimodal Fusion Methods in Physical Human–Robot Interaction: A Review