Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

Robust Identity Verification Based on Human Acoustic Signature with BioHashing.

BioHashing for Human Acoustic Signature Based on Random Projection

Earprint: Transient Evoked Otoacoustic Emission for Biometrics

Biometrics-based identifiers for digital identity management

Human acoustic fingerprints: A novel biometric modality for mobile security

VocalLock

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

A Novel Earprint: Stimulus-Frequency Otoacoustic Emission for Biometric Recognition

BioDeepHash: Mapping Biometrics into a Stable Code

SoundID: Securing Mobile Two-Factor Authentication Via Acoustic Signals

Robust Image Hashing for Image Authentication Based on DCT-DWT Composite Domain

Encrypt with Your Mind: Reliable and Revocable Brain Biometrics Via Multidimensional Gaussian Fitted Bit Allocation.

MLP-Hash: Protecting Face Templates via Hashing of Randomized Multi-Layer Perceptron

Biometric authentication via keystroke sound

Multichannel Acoustic Spectroscopy of the Human Body for Inviolable Biometric Authentication

Biometric-Based Key Generation and User Authentication Using Acoustic Characteristics of the Outer Ear and a Network of Correlation Neurons

Supervised and Unsupervised Alignments for Spoofing Behavioral Biometrics

Robust biometric scheme against replay attacks using one-time biometric templates

Enhancing Template Security of Face Biometrics by Using Edge Detection and Hashing

In-ear EEG biometrics for feasible and readily collectable real-world person authentication

Accuth: Anti-Spoofing Voice Authentication Via Accelerometer.