Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

Sensor-based implicit authentication through learning user physiological and behavioral characteristics

Context-Aware Implicit Authentication of Smartphone Users Based on Multi-Sensor Behavior

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

Dynamic Authentication with Sensory Information for the Access Control Systems.

Push the Limit of WiFi-based User Authentication Towards Undefined Gestures

Performance Evaluation of Implicit Smartphones Authentication Via Sensor-Behavior Analysis.

Modeling interactive sensor-behavior with smartphones for implicit and active user authentication

CaIAuth: Context-Aware Implicit Authentication When the Screen Is Awake

Summary: Multi-modal Biometric-based Implicit Authentication of Wearable Device Users

Implicit Authentication with Sensor Normalization and Multi-Modal Domain Adaption Based on Mobile Crowd Sensing.

Implicit Smartphone User Authentication with Sensors and Contextual Machine Learning

ICAuth: Implicit and Continuous Authentication When the Screen Is Awake

Sensor Data Normalization Among Heterogeneous Smartphones for Implicit Authentication

Implicit Continuous Authentication Model Based on Mobile Terminal Touch Behavior.

An Implicit Identity Authentication Method Based on Deep Connected Attention CNN for Wild Environment

Utter Innocence: Contactless Authentication Method Based on Physiological Signals

PresSafe: Barometer-Based On-Screen Pressure-Assisted Implicit Authentication for Smartphones

Mobile Terminal Identity Authentication System Based on Behavioral Characteristics.

Artificial intelligence in physiological characteristics recognition for internet of things authentication

EchoIA: Implicit Authentication System Based on User Feedback

Implicit Identity Authentication Mechanism Based on Smartphone Touch Dynamics