Abstract:This paper proposes a methodology to assess video quality, spatial and social presence, empathy, attitude, and attention in 360-degree videos for immersive communications. The methodology is validated in an experiment which simulates an immersive communication environment where participants attend three conversations of different genre (everyday conversation, educational, and discussion) and from actor and observer acquisition perspectives. We consider three experimental conditions: (A) visualizing and rating the perceptual quality of contents in a Head-Mounted Display (HMD), (B) visualizing the contents in an HMD, and (C) visualizing the contents in an HMD where participants can see their hands and take notes. In all conditions participants visualize the same 360-degree videos, designed and acquired in the context of international experiences. Fifty-four participants were evenly distributed among A, B, and C conditions taking into account their international experience backgrounds (working or studying in a foreign country), obtaining a balanced and diverse sample of participants. In this paper, video quality is evaluated with Single-Stimulus Discrete Quality Evaluation (SSDQE) methodology. Spatial and social presence are evaluated with questionnaires adapted from the literature. Initial empathy is assessed with Interpersonal Reactivity Index (IRI) and a questionnaire is designed to evaluate the attitude after the visualization of each video. Attention is evaluated with three questions about the conversations of the contents that had pass/fail answers. The results from the subjective test validate the proposed methodology in immersive communications, showing that video quality experiments can be adapted to conditions imposed by experiments focused on the evaluation of socioemotional features in terms of contents of long-duration, different acquisition perspectives, and genre. In addition, the positive results related to the sense of social and spatial presence imply that technology can be relevant in the analyzed use case. Other main result is that the acquisition perspective greatly influences social presence. Finally, the annotated dataset, Student Experiences Around the World dataset (SEAW-dataset), obtained from the experiment is made publicly available for the research community.

Assessing the quality of sensory experience for multimedia presentations

Sensory effects for ambient experiences in the World Wide Web

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

VisibleSound: Perceiving Environmental Sound with 4D Form

Evaluating the effectiveness of audio-visual cues in immersive user interfaces

Towards a Perceived Audiovisual Quality Model for Immersive Content

Multimodality for Passive Experience: Effects of Visual, Auditory, Vibration and Draught Stimuli on Sense of Presence

Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction

Quality of experience assessment for stereoscopic images.

It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour

On the Use of Multi-sensory Cues in Symmetric and Asymmetric Shared Collaborative Virtual Spaces

A Quality of Experience and Visual Attention Evaluation for 360° videos with non-spatial and spatial audio

Sensory Analysis Performed within Augmented Virtuality System: Impact on Hedonic Scores, Engagement, and Presence Level

Digital Sensory Marketing: Integrating New Technologies Into Multisensory Online Experience

Sensory Evaluation of Lighting: A Methodological Pilot

Image Sensory Experience of Artistic Design Based on the Role of Omnidirectional Vision Sensors

Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment

Capturing differences in perception and aesthetic judgment of live or medially presented music: development of a self-report instrument

Methodology to Assess Quality, Presence, Empathy, Attitude, and Attention in 360-degree Videos for Immersive Communications

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

Is more really better for in-store experience? A psychophysiological experiment on sensory modalities