Abstract:Today, touchscreens stand as the most prevalent input devices of mobile computing devices (smartphones, tablets, smartwatches). Yet, compared with desktop or laptop computers, the limited shortcut keys and physical buttons on touchscreen devices, coupled with the fat finger problem, often lead to slower and more error-prone input and navigation, especially when dealing with text editing and other complex interaction tasks. We introduce an innovative gesture set based on finger rotations in the yaw, pitch, and roll directions on a touchscreen, diverging significantly from traditional two-dimensional interactions and promising to expand the gesture library. Despite active research in estimation of finger angles, however, the previous work faces substantial challenges, including significant estimation errors and unstable sequential outputs. Variability in user behavior further complicates the isolation of movements to a single rotational axis, leading to accidental disturbances and screen coordinate shifts that interfere with the existing sliding gestures. Consequently, the direct application of finger angle estimation algorithms for recognizing three-dimensional rotational gestures is impractical. SwivelTouch leverages the analysis of finger movement characteristics on the touchscreen captured through original capacitive image sequences, which aims to rapidly and accurately identify these advanced 3D gestures, clearly differentiating them from conventional touch interactions like tapping and sliding, thus enhancing user interaction with touch devices and meanwhile compatible with existing 2D gestures. User study further confirms that the implementation of SwivelTouch significantly enhances the efficiency of text editing on smartphones.

Air Finger: Enabling Multi-Scale Navigation by Finger Height above the Surface.

A Bare Hand Controlled Ar Map Navigation System

Airfinger: Micro Finger Gesture Recognition Via NIR Light Sensing for Smart Devices

PrintShear

Depth Aware Finger Tapping On Virtual Displays

PrintShear: Shear Input Based on Fingerprint Deformation.

Multi-Touch in the Air: Concurrent Micromovement Recognition Using RF Signals.

Invited - Airtouch: a novel single layer 3D touch sensing system for human/mobile devices interactions

Three Degree-of-Freedom Soft Continuum Kinesthetic Haptic Display for Telemanipulation Via Sensory Substitution at the Finger

SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation Gesture

Digitizing Touch with an Artificial Multimodal Fingertip

A Single Layer 3-D Touch Sensing System for Mobile Devices Application.

Multi - Touch in the Air: Device-Free Finger Tracking and Gesture Recognition Via COTS RFID.

ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow Projection

MouseRing: Always-available Touchpad Interaction with IMU Rings

OneTip: A Soft Tactile Interface for 6-D Fingertip Pose Acquisition in Human-Computer Interaction

Wysiwyf: Exploring And Annotating Volume Data With A Tangible Handheld Device

Multifingered Robot Hand Dynamic Grasping Control Based on Fingertip Three-Axis Tactile Sensor Feedback

Displaying Sensed Tactile Cues with a Fingertip Haptic Device

SpeciFingers: Finger Identification and Error Correction on Capacitive Touchscreens

Ghostfinger: a novel platform for fully computational fingertip controllers