Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

An Intelligent Identity Authentication Method Based on Mouse Trajectory and Wireless Signal

Push the Limit of WiFi-based User Authentication Towards Undefined Gestures

Toward Multi-User Authentication Using WiFi Signals

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

Authentication and Monitoring of User Identities Based on Mouse Dynamics

LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals.

An Efficient User Verification System Using Angle-Based Mouse Movement Biometrics

User Authentication Through Mouse Dynamics

MouseIdentity: Modeling Mouse-Interaction Behavior for a User Verification System

Secure User Authentication Leveraging Keystroke Dynamics via Wi-Fi Sensing

User Authentication and Identity Inconsistency Detection via Mouse-trajectory Similarity Measurement

Dynamic Authentication with Sensory Information for the Access Control Systems.

MultiAuth: Enable Multi-User Authentication with Single Commodity WiFi Device

Triboelectric Sensor-Empowered Intelligent Mouse Combined with Machine Learning Technology Strides Toward a Computer Security System

Feature analysis of mouse dynamics in identity authentication and monitoring

Pattern-Growth Based Mining Mouse-Interaction Behavior for an Active User Authentication System.

An Insider Threat Detection Approach Based on Mouse Dynamics and Deep Learning

User Authentication and Monitoring Based on Mouse Behavioral Features

Continuous Authentication Using Mouse Clickstream Data Analysis

On the Effectiveness and Applicability of Mouse Dynamics Biometric for Static Authentication: A Benchmark Study

Continuous authentication for mouse dynamics: A pattern-growth approach