Abstract:Room-scale immersive data visualisations provide viewers a wide-scale overview of a large dataset, but to interact precisely with individual data points they typically have to navigate to change their point of view. In traditional screen-based visualisations, focus-and-context techniques allow visualisation users to keep a full dataset in view while making detailed selections. Such techniques have been studied extensively on desktop to allow precise selection within large data sets, but they have not been explored in immersive 3D modalities. In this paper we develop a novel immersive focus-and-context technique based on a "magic portal" metaphor adapted specifically for data visualisation scenarios. An extendable-hand interaction technique is used to place a portal close to the region of interest. The other end of the portal then opens comfortably within the user's physical reach such that they can reach through to precisely select individual data points. Through a controlled study with 12 participants, we find strong evidence that portals reduce overshoots in selection and overall hand trajectory length, reducing arm and shoulder fatigue compared to ranged interaction without the portal. The portals also enable us to use a robot arm to provide haptic feedback for data within the limited volume of the portal region. In a second study with another 12 participants we found that haptics provided a positive experience (qualitative feedback) but did not significantly reduce fatigue. We demonstrate applications for portal-based selection through two use-case scenarios.

HapticSeer: A Multi-channel, Black-box, Platform-agnostic Approach to Detecting Video Game Events for Real-time Haptic Feedback

Video2Haptics: Converting Video Motion to Dynamic Haptic Feedback with Bio-Inspired Event Processing

Play games with eyes: A portable EOG based HCI system for game control

Motion-Based Perceptual User Interface

Haptic Sensing and Feedback Techniques toward Virtual Reality

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

Building Virtual Entertainment Environment with Tiled Display Wall and Motion Tracking.

Haptic display for virtual reality: progress and challenges.

Grasp Identification and Multi-Finger Haptic Feedback for Virtual Assembly

Encountered-Type Haptic Display via Tracking Calibrated Robot

Haptic Handshank - A Handheld Multimodal Haptic Feedback Controller for Virtual Reality

Precise Embodied Data Selection with Haptic Feedback while Retaining Room-Scale Visualisation Context

HaptiVec - Presenting Haptic Feedback Vectors in Handheld Controllers using Embedded Tactile Pin Arrays.

Tell Me How You Play: Exploring Ways to Enhance the Gaming Experience in Asymmetric Multiplayer VR Games Through Affective State Visualization

Telemetry-based Haptic Rendering for Racing Game Experience Improvement

Vibration Feedback Controlled by Intuitive Pressing in Virtual Reality.

Intelligent Wearable Virtual Reality (VR) Gaming Controller for People with Motor Disabilities

Analysis and Performance Evaluation of a Modular Finger-Mounted Haptic Device for High-Density Feedback

Miniature Haptics: Experiencing Haptic Feedback Through Hand-based and Embodied Avatars

A Study on Immersion and Presence of a Portable Hand Haptic System for Immersive Virtual Reality

Real-time haptic interaction with RGBD video streams