Abstract:To prevent users’ privacy from leakage, more and more mobile devices employ biometric-based authentication approaches, such as fingerprint, face recognition, voiceprint authentications, and so on, to enhance the privacy protection. However, these approaches are vulnerable to replay attacks. Although the state-of-art solutions utilize liveness verification to combat the attacks, existing approaches are sensitive to ambient environments, such as ambient lights and surrounding audible noises. Toward this end, we explore liveness verification of user authentication leveraging users’ mouth movements, which are robust to noisy environments. In this paper, we propose a lip reading-based user authentication system, LipPass, which extracts unique behavioral characteristics of users’ speaking mouths through acoustic sensing on smartphones for user authentication. We first investigate Doppler profiles of acoustic signals caused by users’ speaking mouths and find that there are unique mouth movement patterns for different individuals. To characterize the mouth movements, we propose a deep learning-based method to extract efficient features from Doppler profiles and employ softmax function, support vector machine, and support vector domain description to construct multi-class identifier, binary classifiers, and spoofer detectors for mouth state identification, user identification, and spoofer detection, respectively. Afterward, we develop a balanced binary tree-based authentication approach to accurately identify each individual leveraging these binary classifiers and spoofer detectors with respect to registered users. Through extensive experiments involving 48 volunteers in four real environments, LipPass can achieve 90.2% accuracy in user identification and 93.1% accuracy in spoofer detection.

Speaker Identity Tracing Using Fingerprint Data Hiding Against Telecommunications Fraud

Forensic Speech Information Hiding Using Fractional Cosine-Cepstrum Transform

You Can Call but You Can't Hide: Detecting Caller ID Spoofing Attacks

VocalLock

Towards Safer Connections: Secure Authentication in 5G Networks Leveraging Radio Frequency Fingerprinting

The Catcher in the Field

LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals.

Defending against Speaker Fingerprinting Based Device Tracking for Smartphones

Governance framework for voice spam detection and interception of telecom network

Lip Reading-Based User Authentication Through Acoustic Sensing on Smartphones.

Detecting telecommunication fraud by understanding the contents of a call

Acoustic Fingerprinting Revisited: Generate Stable Device ID Stealthily with Inaudible Sound

Distinguishable Speaker Anonymization Based on Formant and Fundamental Frequency Scaling

A Non-intrusive and Adaptive Speaker De-Identification Scheme Using Adversarial Examples

You Can Hear But You Cannot Steal: Defending Against Voice Impersonation Attacks on Smartphones

Speaker Anonymization for Personal Information Protection Using Voice Conversion Techniques

Reflection on Prevention and Control of Telecommunication Network Fraud in Big Data Era

An Application-Oriented Taxonomy on Spoofing, Disguise and Countermeasures in Speaker Recognition

Information Hiding Technique Based Speech Secure Communication over Pstn

Fingerprinting Encrypted Voice Traffic on Smart Speakers with Deep Learning

Who is Speaking Actually? Robust and Versatile Speaker Traceability for Voice Conversion