Abstract:The Qwerty soft keyboard is widely used on mobile devices. However, keyboards often consume a large portion of the touchscreen space, occluding the application view on the smartphone and requiring a separate input interface on the smartwatch. Such space consumption can affect the user experience of accessing information and the overall performance of text input. In order to free up the screen real estate, this article explores the concept of Sparse Keyboard and proposes two new ways of presenting the Qwerty soft keyboard. The idea is to use users’ spatial memory and the reference effect of spatial landmarks on the graphical interface. Our final design K3-SGK displays only three keys while L5-EYOCN displays only five line segments instead of the entire Qwerty layout. To achieve this, we employ a user-centered computational design method: first study the reference effect of a single landmark key (line segment) from empirical data, then make assumptions to generalize the effect to multiple landmarks, and finally optimize the best designs. To make the text entry function more complete, we also design and implement gestural interactions for editing operations and non-alphabetical characters’ input. User evaluation shows that participants can quickly learn how to type with K3-SGK and L5-EYOCN . After five 15-phrase typing sessions, participants achieve 88.1%--92.8% of the full Qwerty keyboard in terms of words per minute on the smartphone and 98.4%--99.1% on the smartwatch. The differences on character and word error rate between our keyboard designs and the full Qwerty keyboard are not significant. The results of out-of-vocabulary words input are also promising. In addition, participants can quickly recall the typing skills and maintain the input performance even after a few days. User feedbacks in real application contexts show that with the low occlusion keyboard, users can acquire more information and perform less scrolling on the smartphone and achieve a higher input efficiency on the smartwatch with a more fluent input experience.

SwingBoard: introducing swipe based virtual keyboard for visually impaired and blind users

VIPBoard - Improving Screen-Reader Keyboard for Visually Impaired People with Character-Level Auto Correction.

Exploring the Impact of Word Prediction Assistive Features on Smartphone Keyboards for Blind Users

A Haptic Braille Keyboard Layout for Smartphone Applications

Design and evaluation of a time adaptive multimodal virtual keyboard

Text entry via character stroke disambiguation for an adolescent with severe motor impairment and cortical visual impairment

A multimodal virtual keyboard using eye-tracking and hand gesture detection

Wearable Virtual Keyboard for Visually Impaired Person

Eye-shaped keyboard for dual-hand text entry in virtual reality

Virtual keyboard with the prediction of words for children with cerebral palsy

Exploring Low-Occlusion Qwerty Soft Keyboard Using Spatial Landmarks

Predictive Tree-based Virtual Keyboard for Improved Gaze Typing

Finger Based Technique (FBT): An Innovative System for Improved Usability for the Blind Users' Dynamic Interaction with Mobile Touch Screen Devices

Finger Based Techniques for Nonvisual Touchscreen Text Entry

Eye Gaze Controlled Virtual Keyboard

Multi-stage gaze-controlled virtual keyboard using eye tracking

A mechanism for blind-friendly user interface adaptation of mobile apps: a case study for improving the user experience of the blind people

BlindType

The dynamic grouping keyboard: a general keyboard optimization approach for users with motor impairment

Design of virtual keyboard using blink control method for the severely disabled

I-Keyboard: Fully Imaginary Keyboard on Touch Devices Empowered by Deep Neural Decoder