Abstract:Recent technological advances have made head-mounted displays (HMDs) smaller and untethered, fostering the vision of ubiquitous interaction with information in a digitally augmented physical world. For interacting with such devices, three main types of input - besides not very intuitive finger gestures - have emerged so far: 1) Touch input on the frame of the devices or 2) on accessories (controller) as well as 3) voice input. While these techniques have both advantages and disadvantages depending on the current situation of the user, they largely ignore the skills and dexterity that we show when interacting with the real world: Throughout our lives, we have trained extensively to use our limbs to interact with and manipulate the physical world around us. This thesis explores how the skills and dexterity of our upper and lower limbs, acquired and trained in interacting with the real world, can be transferred to the interaction with HMDs. Thus, this thesis develops the vision of around-body interaction, in which we use the space around our body, defined by the reach of our limbs, for fast, accurate, and enjoyable interaction with such devices. This work contributes four interaction techniques, two for the upper limbs and two for the lower limbs: The first contribution shows how the proximity between our head and hand can be used to interact with HMDs. The second contribution extends the interaction with the upper limbs to multiple users and illustrates how the registration of augmented information in the real world can support cooperative use cases. The third contribution shifts the focus to the lower limbs and discusses how foot taps can be leveraged as an input modality for HMDs. The fourth contribution presents how lateral shifts of the walking path can be exploited for mobile and hands-free interaction with HMDs while walking.

Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces

Wearable-based Human-Computer Interaction with LimbMotion

Advancing Virtual Reality Interaction: A Ring-Shaped Controller and Pose Tracking

COMTIS: Customizable Touchless Interaction System for Large Screen Visualization

Exploring Data Input Problems in Mixed Reality Environments: Proposal and Evaluation of Natural Interaction Techniques

ARO: Exploring the Design of Smart-Ring Interactions for Encumbered Hands

3DTouch: A wearable 3D input device with an optical sensor and a 9-DOF inertial measurement unit

Haptic Feedback Relocation from the Fingertips to the Wrist for Two-Finger Manipulation in Virtual Reality

Independence in the Home: A Wearable Interface for a Person with Quadriplegia to Teleoperate a Mobile Manipulator

Precise Embodied Data Selection with Haptic Feedback while Retaining Room-Scale Visualisation Context

Exploring Hand-Based Haptic Interfaces for Mobile Interaction Design

Towards Interaction Around Unmodified Camera-equipped Mobile Devices

HAT: Head-Worn Assistive Teleoperation of Mobile Manipulators

MouseRing: Always-available Touchpad Interaction with IMU Rings

Around-Body Interaction: Leveraging Limb Movements for Interacting in a Digitally Augmented Physical World

Wearable Ultrasound-Based Decoding of Simultaneous Wrist/Hand Kinematics

iDial: Enabling a Virtual Dial Plate on the Hand Back for Around-Device Interaction.

Designing and Evaluating Hand-to-Hand Gestures with Dual Commodity Wrist-Worn Devices

Combining Vision and EMG-Based Hand Tracking for Extended Reality Musical Instruments

Evaluating Positional Head-Tracking in Immersive VR for 3D Designers