Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

Biomimetics Speaker Identification Systems for Network Security Gatekeepers

FenceSitter: Black-box, Content-Agnostic, and Synchronization-Free Enrollment-Phase Attacks on Speaker Recognition Systems

VocalLock

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

Mmear: Push the Limit of COTS Mmwave Eavesdropping on Headphones

LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals.

The Silent Manipulator: A Practical and Inaudible Backdoor Attack against Speech Recognition Systems

High-quality Speech Recovery Through Soundproof Protections Via Mmwave Sensing

EarPass: Secure and Implicit Call Receiver Authentication Using Ear Acoustic Sensing

SilentKey: A New Authentication Framework Through Ultrasonic-based Lip Reading.

mmSafe: A Voice Security Verification System Based on Millimeter-Wave Radar

N-Gram Nearest Neighbor Algorithm For Voice Password System

You Can Hear But You Cannot Steal: Defending Against Voice Impersonation Attacks on Smartphones

VocalPrint: A mmWave-based Unmediated Vocal Sensing System for Secure Authentication

Enrollment-stage Backdoor Attacks on Speaker Recognition Systems via Adversarial Ultrasound

Secure User Authentication Leveraging Keystroke Dynamics via Wi-Fi Sensing

An Eavesdropping System Based on Magnetic Side-Channel Signals Leaked by Speakers

Prevention of Impostors Entering Speaker Recognition Systems

Auditory Model Based Speech Feature Extraction and Its Application to Speaker Identification

Voice Spoofing Countermeasure for Voice Replay Attacks Using Deep Learning

Wireless Device Authentication Using Acoustic Hardware Fingerprints