Abstract:Restricted by the limited interaction area of native AR glasses, creating sketches is a challenge in it. Existing solutions attempt to use mobile devices (e.g., tablets) or mid-air hand gestures to expand the interactive spaces and as the 2D/3D sketching input interfaces for AR glasses. Between them, mobile devices allow for accurate sketching but are often heavy to carry. Sketching with bare hands is zero-burden but can be inaccurate due to arm instability. In addition, mid-air sketching can easily lead to social misunderstandings and its prolonged use can cause arm fatigue. In this work, we present WristSketcher, a new AR system based on a flexible sensing wristband that enables users to place multiple virtual plane canvases in the real environment and create 2D dynamic sketches based on them, featuring an almost zero-burden authoring model for accurate and comfortable sketch creation in real-world scenarios. Specifically, we streamlined the interaction space from the mid-air to the surface of a lightweight sensing wristband, and implemented AR sketching and associated interaction commands by developing a gesture recognition method based on the sensing pressure points. We designed a set of interactive gestures consisting of Long Press , Tap and Double Tap based on a heuristic study involving 26 participants. These gestures are correspondingly mapped to various command interactions using a combination of multi-touch and hotspots. Moreover, we endow our WristSketcher with the ability of animation creation, allowing it to create dynamic and expressive sketches. Experimental results demonstrate that our WristSketcher (i) recognizes users' gesture interactions with a high accuracy of 95.9%; (ii) achieves higher sketching accuracy than Freehand sketching; (iii) achieves high user satisfaction in ease of use, usability and functionality; and (iv) shows innovation potentials in art creation, memory aids, and entertainment applications.

GestureSurface: VR Sketching Through Assembling Scaffold Surface with Non-Dominant Hand.

Pen-based gesture design and recognition for sketch editing

An online sketching and gesture editing system for conceptual design

Using the CAT for 3D Sketching in Front of Large Displays

PENCIL: A Framework for Expressing Free-Hand Sketching in 3D

Model-Guided 3D Sketching

SweepCanvas: Sketch-based 3D Prototyping on an RGB-D Image

Separating and Recognizing Gestural Strokes for Sketch-Based Interfaces

4Doodle: Two-handed Gestures for Immersive Sketching of Architectural Models

WristSketcher: Creating 2D Dynamic Sketches in AR With a Sensing Wristband

Behavior Mapping Of Sketching In Vr Space With Physical Tablet Interface

WristSketcher: Creating Dynamic Sketches in AR with a Sensing Wristband

Double Doodles: Sketching Animation in Immersive Environment With 3+6 DOFs Motion Gestures

An Empirical Practice of Design and Evaluation of Freehand Interaction Gestures in Virtual Reality

GesMoSketch: A System for 3D Sketching in AR with One Mobile Device

Combining Gesture and Voice Control for Mid-Air Manipulation of CAD Models in VR Environments

Shape Modifying and Controlling with Sensor Glove in Virtual Reality

Virtual 3D Sculpturing with a Parametric Hand Surface

Elicitation and Evaluation of Hand-based Interaction Language for 3D Conceptual Design in Mixed Reality

VRSmartphoneSketch: Augmenting VR Controller With A Smartphone For Mid-air Sketching

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR