Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

On-line Signature Verification Method by Laplacian Spectral Analysis and Dynamic Time Warping.

LVID: A Multimodal Biometrics Authentication System on Smartphones.

LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals.

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

On-Line Signature Verification Utilizing 3-Axis Force Features Extraction Based on Dwt

An Efficient DTW Matching for On-line Signature Verification

Improved Dynamic Time Warping (DTW) Approach for Online Signature Verification

Online Signature Verification Based on Statistical Modeling of Characteristic Points

mmSign: mmWave-based Few-Shot Online Handwritten Signature Verification

Handwritten Signature Verification Using Hand-Worn Devices

Dynamic feature analysis of handwritten electronic signatures based on Fourier transform

Dynamic Structural Statistical Model Based Online Signature Verification

SM-DTW: Stability Modulated Dynamic Time Warping for signature verification

A new algorithm for identity verification based on the analysis of a handwritten dynamic signature

Smart Analytical Signature Verification For DSP Applications

Online Signature Verification Based on Weighted Dynamic Programming Matching

Acoustic Sensing Based on Online Handwritten Signature Verification

Writer-independent online signature verification based on 2D representation of time series data using triplet supervised network

mmHSV: In-Air Handwritten Signature Verification via Millimeter-wave Radar

Synchronous spatio-temporal signature verification via Fusion Triplet Supervised Network

Sequence Matching Based Feature Extraction With Applications To Signature Verification