Abstract:One rising trend in today's consumer electronics is the wearable devices, e.g., smartwatches. With tens of millions of smartwatches shipped, however, the security implications of such devices are not fully understood. Although previous studies have pointed out some privacy concerns about the data that can be collected, like personalized health information, the threat is considered low as the leaked data is not highly sensitive and there is no real attack implemented. In this paper we investigate a security problem coming from sensors in smartwatches, especially the accelerometer. The results show that the actual threat is much beyond people's awareness.Being worn on the wrist, the accelerometer built within a smartwatch can track user's hand movements, which makes inferring user inputs on keyboards possible in theory. But several challenges need to be addressed ahead in the real-world settings: e.g., small and irregular hand movements occur persistently during typing, which degrades the tracking accuracy and sometimes even overwhelms useful signals.In this paper, we present a new and practical side-channel attack to infer user inputs on keyboards by exploiting sensors in smartwatch. Novel keystroke inference models are developed to mitigate the negative impacts of tracking noises. We focus on two major categories of keyboards: one is numeric keypad that is generally used to input digits, and the other is QWERTY keyboard on which a user can type English text. Two prototypes have been built to infer users' banking PINs and English text when they type on POS terminal and QWERTY keyboard respectively. Our results show that for numeric keyboard, the probability of finding banking PINs in the top 3 candidates can reach 65%, while for QWERTY keyboard, a significant accuracy improvement is achieved compared to the previous works, especially of the success rate of finding the correct word in the top 10 candidates.

I Know What You Type: Leaking User Privacy Via Novel Frequency-Based Side-Channel Attacks

Key Listener: Inferring Keystrokes on QWERTY Keyboard of Touch Screen Through Acoustic Signals

DeepMag+: Sniffing Mobile Apps in Magnetic Field Through Deep Learning.

GhostType: the Limits of Using Contactless Electromagnetic Interference to Inject Phantom Keys into Analog Circuits of Keyboards

ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks

When Good Becomes Evil: Keystroke Inference With Smartwatch

I Know Your Keyboard Input

MagAttack - Guessing Application Launching and Operation via Smartphone.

Secure Keyboards Against Motion Based Keystroke Inference Attack.

An Indirect Eavesdropping Attack of Keystrokes on Touch Screen through Acoustic Sensing

WebLogger: Stealing Your Personal PINs Via Mobile Web Application

TextLogger: inferring longer inputs on touch screen using motion sensors.

Hearing your touch: A new acoustic side channel on smartphones

Niffler: A Context-Aware and User-Independent Side-Channel Attack System for Password Inference

Keystroke Recognition with the Tapping Sound Recorded by Mobile Phone Microphones

Smartwatch-Based Keystroke Inference Attacks And Context-Aware Protection Mechanisms

Eavesdrop with PoKeMon: Position free keystroke monitoring using acoustic data.

Deep Learning and NLP based Side Channel Attack for Text Inference in Smartphones

Context-Free Attacks Using Keyboard Acoustic Emanations

Revealing Your Mobile Password Via WiFi Signals: Attacks and Countermeasures

Side-Channel Inference Attacks on Mobile Keypads using Smartwatches