3VR: Vice Versa Virtual Reality Algorithm to Track and Map User Experience

Iva Vasic,Ramona Quattrini,Roberto Pierdicca,Adriano Mancini,Bata Vasic

DOI: https://doi.org/10.1145/3656346

2024-04-07

Journal on Computing and Cultural Heritage

Abstract:The understanding of how users interact with the virtual cultural heritage could provide digital curators valuable insights into user behaviors, and also improve the overall user experience through the ability to observe and record interactions of virtual visitors. This paper introduces the new User Behavior (UB) tracking algorithm that we developed investigating a salience of the Virtual Reality (VR) panoramic regions. The algorithm extracts the importance of Region of Interest (ROI) determining patterns of the visitors' virtual movement and interest in combination with statistics of captured browser activity. The input of our algorithm is the virtual online interactive platform (Virtual Museum of the Civic Art Gallery of Ascoli Piceno in Italy) with eighty-one 16386x8192 pixels panoramic images and several interactive features including maps, thumbnails, and menus. The software engine of the tracking model "Vice Versa" VR (3VR) operates on inverse functions of all descriptive functions (descriptors), which are assigned particularly to each interactive feature such as viewing multimedia content and observing the panoramic environment. The tracking experiment was performed online and the web virtual museum key study collected behavior information from 171 visitors around the world. Collected data, multimedia and textual content, and the coordinates of the ROIs are then subjected to standard statistics operations in order to define common patterns of UBs. Thus, we have discovered that the ROIs are mostly mapped onto the artworks and it is possible to obtain patterns about the main interests of users. The developed tool offers a guideline for the panoramic tours design and the potential benefits for museums are to understand the public, verify the effectiveness of choices, and re-shape a cultural offer based on visitors' needs. Exploiting this kind of user experience, our algorithm ensures relevant feedback during virtual visits, and thus paves the way for further development of the recommender system.

computer science, interdisciplinary applications

What problem does this paper attempt to address?

The problem this paper attempts to address is understanding and tracking user interaction behavior in virtual cultural sites to provide valuable insights for digital curators, thereby improving the overall user experience. Specifically, the paper introduces a new User Behavior (UB) tracking algorithm that determines users' virtual movement patterns and points of interest by analyzing the significance of Virtual Reality (VR) panoramic areas. This algorithm combines browser activity statistics to extract patterns of important Regions of Interest (ROI). In this way, researchers hope to identify users' main points of interest and provide guidance for the design of virtual museums, enabling museums to better understand audience needs, validate the effectiveness of their decisions, and reshape cultural products based on visitors' needs.

The main research contributions include:
1. Developing a virtual online interactive platform, namely the virtual museum of the Municipal Art Gallery of Ascoli Piceno, Italy.
2. Proposing a novel user data collection method, the "Reverse Virtual Reality" (3VR) algorithm.

By collecting and analyzing these data, researchers demonstrated that the correlation between the equidistant cylindrical projection of view positions and the field of view parameter values is crucial for defining significant areas. Additionally, the algorithm can track events triggered when specific buttons are activated, helping to understand user behavior patterns and preferences in virtual reality environments.