Abstract:The Qwerty soft keyboard is widely used on mobile devices. However, keyboards often consume a large portion of the touchscreen space, occluding the application view on the smartphone and requiring a separate input interface on the smartwatch. Such space consumption can affect the user experience of accessing information and the overall performance of text input. In order to free up the screen real estate, this article explores the concept of Sparse Keyboard and proposes two new ways of presenting the Qwerty soft keyboard. The idea is to use users’ spatial memory and the reference effect of spatial landmarks on the graphical interface. Our final design K3-SGK displays only three keys while L5-EYOCN displays only five line segments instead of the entire Qwerty layout. To achieve this, we employ a user-centered computational design method: first study the reference effect of a single landmark key (line segment) from empirical data, then make assumptions to generalize the effect to multiple landmarks, and finally optimize the best designs. To make the text entry function more complete, we also design and implement gestural interactions for editing operations and non-alphabetical characters’ input. User evaluation shows that participants can quickly learn how to type with K3-SGK and L5-EYOCN . After five 15-phrase typing sessions, participants achieve 88.1%--92.8% of the full Qwerty keyboard in terms of words per minute on the smartphone and 98.4%--99.1% on the smartwatch. The differences on character and word error rate between our keyboard designs and the full Qwerty keyboard are not significant. The results of out-of-vocabulary words input are also promising. In addition, participants can quickly recall the typing skills and maintain the input performance even after a few days. User feedbacks in real application contexts show that with the low occlusion keyboard, users can acquire more information and perform less scrolling on the smartphone and achieve a higher input efficiency on the smartwatch with a more fluent input experience.

ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting Fingers

TypeBoard: Identifying Unintentional Touch on Pressure-Sensitive Touchscreen Keyboards.

TapType: Ten-finger text entry on everyday surfaces via Bayesian inference

AirText: One-Handed Text Entry in the Air for COTS Smartwatches

TOAST: Ten-Finger Eyes-Free Typing on Touchable Surfaces.

PrinType: Text Entry via Fingerprint Recognition.

I-Keyboard: Fully Imaginary Keyboard on Touch Devices Empowered by Deep Neural Decoder

Typing on Any Surface: A Deep Learning-based Method for Real-Time Keystroke Detection in Augmented Reality

PrinType

DRG-Keyboard: Enabling Subtle Gesture Typing on the Fingertip with Dual IMU Rings.

Exploring Low-Occlusion Qwerty Soft Keyboard Using Spatial Landmarks

BlindType

DRG-Keyboard

Typing Everywhere with an EMG Keyboard: A Novel Myo Armband-Based HCI Tool

AirTyping

Typing on Split Keyboards with Peripheral Vision.

Force9: Force-assisted Miniature Keyboard on Smart Wearables.

QwertyRing: Text Entry on Physical Surfaces Using a Ring

From 2D to 3D: Facilitating Single-Finger Mid-Air Typing on Virtual Keyboards with Probabilistic Touch Modeling

HiKeyb: High-Efficiency Mixed Reality System for Text Entry

Quadmetric Optimized Thumb-to-Finger Interaction for Force Assisted One-Handed Text Entry on Mobile Headsets