Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

WristPass: Secure Wearable Continuous Authentication Via Ultrasonic Sensing

M-PPG: A Non-intrusive Authentication for Wearable Devices Via PPG Sensors with Motor Excitations

<i>ChestLive</i>: Fortifying Voice-based Authentication with Chest Motion Biometric on Smart Devices

LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals.

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

VocalLock

WristAuthen: A Dynamic Time Wrapping Approach for User Authentication by Hand-Interaction through Wrist-Worn Devices

Towards Nonintrusive and Secure Mobile Two-Factor Authentication on Wearables

WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing

WACA: Wearable-Assisted Continuous Authentication

Secure User Authentication Leveraging Keystroke Dynamics via Wi-Fi Sensing

PalmEcho: Multimodal Authentication for Smartwatch Via Beating Gestures

Hand-Interactive Behavior Analysis for User Authentication Systems with Wrist-Worn Devices

Shake, Shake, I Know Who You Are: Authentication Through Smart Wearable Devices

Secure User Verification and Continuous Authentication Via Earphone IMU

A Continuous Identity Authentication Scheme Based On Physiological And Behavioral Characteristics

Accuth$^+$ : Accelerometer-based Anti-Spoofing Voice Authentication on Wrist-worn Wearables

BreathPass: Ultrasounic Authentication by Chest and Abdomen Movement While Breathing

Power Saving and Secure Text Input for Commodity Smart Watches

HeartPrint: Exploring a Heartbeat-Based Multiuser Authentication With Single mmWave Radar

Adaptive Human-Machine Interactive Behavior Analysis With Wrist-Worn Devices for Password Inference