Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

Cross-device free-text keystroke dynamics authentication using federated learning

Machine Learning-Based Analysis of Free-Text Keystroke Dynamics

Free-Text Keystroke Dynamics for User Authentication

VocalLock

CrossBehaAuth: Cross-Scenario Behavioral Biometrics Authentication Using Keystroke Dynamics.

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals.

Machine Learning and Deep Learning for Fixed-Text Keystroke Dynamics

Keystroke Dynamics Authentication For Collaborative Systems

Keystroke Dynamics for User Identification

Evaluation Scheme to Analyze Keystroke Dynamics Methods

Biometric authentication via keystroke sound

Keystroke Dynamics: Concepts, Techniques, and Applications

Authenticating User's Keystroke Based on Statistical Models

A Generic Privacy-Preserving Protocol For Keystroke Dynamics-Based Continuous Authentication

Piezoelectric and Machine Learning Based Keystroke Dynamics For Highly Secure User Authentication

User Authentication by Keystroke Dynamics Using Machine Learning Algorithms

Free-text Keystroke Authentication using Transformers: A Comparative Study of Architectures and Loss Functions

Applied Federated Learning: Improving Google Keyboard Query Suggestions

Combating Password Vulnerability with Keystroke Dynamics Featured by WiFi Sensing

KDPrint: Passive Authentication using Keystroke Dynamics-to-Image Encoding via Standardization