Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

TBAuth: A continuous authentication framework based on tap behavior for smartphones

ToAuth: Towards Automatic Near Field Authentication for Smartphones

MMAuth: A Continuous Authentication Framework on Smartphones Using Multiple Modalities

Motion-senor Behavior Analysis for Continuous Authentication on Smartphones

CT-Auth: Capacitive Touchscreen-Based Continuous Authentication on Smartphones

Continuous Mobile Authentication Using Virtual Key Typing Biometrics

Touch-interaction Behavior for Continuous User Authentication on Smartphones

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

Who is Using the Phone? Representation-Learning-Based Continuous Authentication on Smartphones

Towards Continuous and Passive Authentication via Touch Biometrics: An Experimental Study on Smartphones.

IncreAuth: Incremental-Learning-Based Behavioral Biometric Authentication on Smartphones

Performance Analysis of Multi-Motion Sensor Behavior for Active Smartphone Authentication

Mobile Authentication through Touch-Behavior Features.

Modeling interactive sensor-behavior with smartphones for implicit and active user authentication

Continuous Mobile Authentication Using Touchscreen Gestures

TouchPass: Towards Behavior-irrelevant on-touch User Authentication on Smartphones Leveraging Vibrations

Multi-source Interactive Behavior Analysis for Continuous User Authentication on Smartphones.

Security after login: Identity change detection on smartphones using sensor fusion

An HMM-based Multi-sensor Approach for Continuous Mobile Authentication

Multi-Motion Sensor Behavior based Continuous Authentication on Smartphones using Gated Two-Tower Transformer Fusion Networks

Mobile Terminal Identity Authentication System Based on Behavioral Characteristics.