Abstract:Physical face-to-face collaboration with someone gives a higher-quality experience compared to mediated communication options, such as a phone- or video-based chat. Participants can share rich sensory cues to multiple human senses in a physical space. Also, the perceptual sensing of the surrounding environment including other peoples' reactions can influence human communication and emotion, and thus collaborative performance. Shared spaces in virtual environments provide degraded sensory experiences because most commercial virtual reality systems typically provide only visual and audio feedback. The impact of richer, multi-sensory feedback on joint decision-making tasks in VR is still an open area of research. Two independent studies exploring this topic are presented in this paper. We implemented a multi-sensory system that delivers vision, audio, tactile, and smell feedback, and we compared the system to a typical VR system. The scenario placed two users in a virtual theme-park safari ride with a number of non-player character (NPC) passengers to simulate realistic scenarios compared to the real-world and we varied the type and complexity of NPCs reactions to participants. In Experiment 1, we provided both users with either multi-sensory or typical sensory feedback symmetrically as a between-subjects factor, and used NPC reaction type as a within-subjects factor. In Experiment 2, we provided sensory feedback asymmetrically to each user (i.e., one had multi-sensory cues and the other had typical sensory cues) as a between-subjects factor, and used NPC reaction type as a within-subjects factor. We found that the number of sensory channels and NPC reactions did not influence user perception significantly under either symmetric or asymmetric sensory feedback conditions. However, after accounting for individual personality traits (e.g., assertive, passive), as well as any existing relationship between the pairs, we found that increasing the number of sensory channels can significantly improve subjective responses.

The effects of spatial auditory and visual cues on mixed reality remote collaboration

A Novel MR Remote Collaboration System Using 3D Spatial Area Cue and Visual Notification

Do You Know What I Mean? an MR-Based Collaborative Platform

Spatial Auditory Cueing for a Dynamic Three-Dimensional Virtual Reality Visual Search Task

Spatial Perception Enhancement in Assembly Training Using Augmented Volumetric Playback

Real-time 3D video-based MR remote collaboration using gesture cues and virtual replicas

Can you notice my attention? A novel information vision enhancement method in MR remote collaborative assembly

The combination of visual communication cues in mixed reality remote collaboration

Mixed Reality Spatial Computing in a Remote Learning Classroom

Effect of Visual Cues on Pointing Tasks in Co-located Augmented Reality Collaboration

On the Use of Multi-sensory Cues in Symmetric and Asymmetric Shared Collaborative Virtual Spaces

Collaborative MR Workspace with Shared 3D Vision Based on Stereo Video Transmission

eyemR-Vis: A Mixed Reality System to Visualise Bi-Directional Gaze Behavioural Cues Between Remote Collaborators

Haptic Feedback Helps Me? A VR-SAR Remote Collaborative System with Tangible Interaction

Mixed reality-based coordinate system for enhancing survey knowledge acquisition: a study on allocentric and egocentric perspectives

Spatial Affordance-aware Interactable Subspace Allocation for Mixed Reality Telepresence

The Effect of Audiovisual Spatial Design on User Experience of Bare-Hand Interaction in VR

Spatial Knowledge via Auditory Information for Blind Individuals: Spatial Cognition Studies and the Use of Audio-VR

A gesture- and head-based multimodal interaction platform for MR remote collaboration

Real-time Visual Representations for Mobile Mixed Reality Remote Collaboration

Using a Head Pointer or Eye Gaze: the Effect of Gaze on Spatial AR Remote Collaboration for Physical Tasks.