VR.net: A Real-world Dataset for Virtual Reality Motion Sickness Research

Elliott Wen,Chitralekha Gupta,Prasanth Sasikumar,Mark Billinghurst,James Wilmott,Emily Skow,Arindam Dey,Suranga Nanayakkara
2023-06-06
Abstract:Researchers have used machine learning approaches to identify motion sickness in VR experience. These approaches demand an accurately-labeled, real-world, and diverse dataset for high accuracy and generalizability. As a starting point to address this need, we introduce `<a class="link-external link-http" href="http://VR.net" rel="external noopener nofollow">this http URL</a>', a dataset offering approximately 12-hour gameplay videos from ten real-world games in 10 diverse genres. For each video frame, a rich set of motion sickness-related labels, such as camera/object movement, depth field, and motion flow, are accurately assigned. Building such a dataset is challenging since manual labeling would require an infeasible amount of time. Instead, we utilize a tool to automatically and precisely extract ground truth data from 3D engines' rendering pipelines without accessing VR games' source code. We illustrate the utility of <a class="link-external link-http" href="http://VR.net" rel="external noopener nofollow">this http URL</a> through several applications, such as risk factor detection and sickness level prediction. We continuously expand <a class="link-external link-http" href="http://VR.net" rel="external noopener nofollow">this http URL</a> and envision its next version offering 10X more data than the current form. We believe that the scale, accuracy, and diversity of <a class="link-external link-http" href="http://VR.net" rel="external noopener nofollow">this http URL</a> can offer unparalleled opportunities for VR motion sickness research and beyond.
Artificial Intelligence
What problem does this paper attempt to address?