Abstract:Virtual Reality (VR) is an exciting new consumer technology which offers an immersive audio-visual experience to users through which they can navigate and interact with a digitally represented 3D space (i.e., a virtual world) using a headset device. By (visually) transporting users from the real or physical world to exciting and realistic virtual spaces, VR systems can enable true-to-life and more interactive versions of traditional applications such as gaming, remote conferencing, social networking and virtual tourism. However, as with any new consumer technology, VR applications also present significant user-privacy challenges. This paper studies a new type of privacy attack targeting VR users by connecting their activities visible in the virtual world (enabled by some VR application/service) to their physical state sensed in the real world. Specifically, this paper analyzes the feasibility of carrying out a de-anonymization or identification attack on VR users by correlating visually observed movements of users' avatars in the virtual world with some auxiliary data (e.g., motion sensor data from mobile/wearable devices held by users) representing their context/state in the physical world. To enable this attack, this paper proposes a novel framework which first employs a learning-based activity classification approach to translate the disparate visual movement data and motion sensor data into an activity-vector to ease comparison, followed by a filtering and identity ranking phase outputting an ordered list of potential identities corresponding to the target visual movement data. Extensive empirical evaluation of the proposed framework, under a comprehensive set of experimental settings, demonstrates the feasibility of such a de-anonymization attack.

Privacy-preserving datasets of eye-tracking samples with applications in XR

A privacy-preserving approach to streaming eye-tracking data

Privacy-Aware Eye Tracking Using Differential Privacy

Privacy-Preserving Gaze Data Streaming in Immersive Interactive Virtual Reality: Robustness and User Experience

DPGazeSynth: Enhancing Eye-tracking Virtual Reality Privacy with Differentially Private Data Synthesis

Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges

Exploiting the Uncoordinated Privacy Protections of Eye Tracking and VR Motion Data for Unauthorized User Identification

PrivacEye: Privacy-Preserving Head-Mounted Eye Tracking Using Egocentric Scene Image and Eye Movement Features

Differential Privacy for Eye Tracking with Temporal Correlations

The Security-Utility Trade-off for Iris Authentication and Eye Animation for Social Virtual Avatars

A 6dof VR Dataset of 3D Virtualworld for Privacy-Preserving Approach and Utility-Privacy Tradeoff.

Privacy Implications of Eye Tracking in Mixed Reality

Inferring Private Personal Attributes of Virtual Reality Users from Head and Hand Motion Data

Privacy-Preserving Eye-tracking Using Deep Learning

Privacy-Phys: Facial Video-Based Physiological Modification for Privacy Protection

Who Is Alyx? A new Behavioral Biometric Dataset for User Identification in XR

Privacy-Preserving Remote Heart Rate Estimation from Facial Videos

Privacy concerns from variances in spatial navigability in VR

Exploring the Privacy Risks of Adversarial VR Game Design

Exploiting Out-of-band Motion Sensor Data to De-anonymize Virtual Reality Users

Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality