Abstract:Touch typing on flat surfaces (e.g. interactive tabletop) is challenging due to lack of tactile feedback and hand drifting. In this paper, we present TOAST, an eyes-free keyboard technique for enabling efficient touch typing on touch-sensitive surfaces. We first formalized the problem of keyboard parameter (e.g. location and size) estimation based on users' typing data. Through a user study, we then examined users' eyes-free touch typing behavior on an interactive tabletop with only asterisk feedback. We fitted the keyboard model to the typing data, results suggested that the model parameters (keyboard location and size) changed not only between different users, but also within the same user along with time. Based on the results, we proposed a Markov-Bayesian algorithm for input prediction, which considers the relative location between successive touch points within each hand respectively. Simulation results showed that based on the pooled data from all users, this model improved the top-1 accuracy of the classical statistical decoding algorithm from 86.2% to 92.1%. In a second user study, we further improved TOAST with dynamical model parameter adaptation, and evaluated users' text entry performance with TOAST using realistic text entry tasks. Participants reached a pick-up speed of 41.4 WPM with a character-level error rate of 0.6%. And with less than 10 minutes of practice, they reached 44.6 WPM without sacrificing accuracy. Participants' subjective feedback also indicated that TOAST offered a natural and efficient typing experience.

PalmBoard: Leveraging Implicit Touch Pressure in Statistical Decoding for Indirect Text Entry.

Pushing the Communication Speed Limit of a Noninvasive BCI Speller

ForceBoard: Subtle Text Entry Leveraging Pressure.

From 2D to 3D: Facilitating Single-Finger Mid-Air Typing on Virtual Keyboards with Probabilistic Touch Modeling

Investigating Gesture Typing for Indirect Touch

TypeBoard: Identifying Unintentional Touch on Pressure-Sensitive Touchscreen Keyboards.

I-Keyboard: Fully Imaginary Keyboard on Touch Devices Empowered by Deep Neural Decoder

TOAST: Ten-Finger Eyes-Free Typing on Touchable Surfaces.

BlindType

TapType: Ten-finger text entry on everyday surfaces via Bayesian inference

Typing on Split Keyboards with Peripheral Vision.

ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting Fingers

Facilitating Text Entry on Smartphones with QWERTY Keyboard for Users with Parkinson's Disease

Hand Posture's Effect on Touch Screen Text Input Behaviors: A Touch Area Based Study

Classifying Real and Imaginary Finger Press Tasks on a P300-based Brain-Computer Interface.

A Monte Carlo Simulation Approach for Quantitatively Evaluating Keyboard Layouts for Gesture Input

Typing Everywhere with an EMG Keyboard: A Novel Myo Armband-Based HCI Tool

PinchText: One-Handed Text Entry Technique Combining Pinch Gestures and Hand Positions for Head-Mounted Displays

VIPBoard - Improving Screen-Reader Keyboard for Visually Impaired People with Character-Level Auto Correction.

Ability-Based Methods for Personalized Keyboard Generation

Atk: Enabling Ten-Finger Freehand Typing In Air Based On 3d Hand Tracking Data