Abstract:In this paper, we propose an enhanced version of the Authentication with Built-in Camera (ABC) protocol by employing a deep learning solution based on built-in motion sensors. The standard ABC protocol identifies mobile devices based on the photo-response non-uniformity (PRNU) of the camera sensor, while also considering QR-code-based meta-information. During registration, users are required to capture photos using their smartphone camera. The photos are sent to a server that computes the camera fingerprint, storing it as an authentication trait. During authentication, the user is required to take two photos that contain two QR codes presented on a screen. The presented QR code images also contain a unique probe signal, similar to a camera fingerprint, generated by the protocol. During verification, the server computes the fingerprint of the received photos and authenticates the user if (i) the probe signal is present, (ii) the metadata embedded in the QR codes is correct and (iii) the camera fingerprint is identified correctly. However, the protocol is vulnerable to forgery attacks when the attacker can compute the camera fingerprint from external photos, as shown in our preliminary work. Hence, attackers can easily remove their PRNU from the authentication photos without completely altering the probe signal, resulting in attacks that bypass the defense systems of the ABC protocol. In this context, we propose an enhancement to the ABC protocol, using motion sensor data as an additional and passive authentication layer. Smartphones can be identified through their motion sensor data, which, unlike photos, is never posted by users on social media platforms, thus being more secure than using photographs alone. To this end, we transform motion signals into embedding vectors produced by deep neural networks, applying Support Vector Machines for the smartphone identification task. Our change to the ABC protocol results in a multi-modal protocol that lowers the false acceptance rate for the attack proposed in our previous work to a percentage as low as 0.07%. In this paper, we present the attack that makes ABC vulnerable, as well as our multi-modal ABC protocol along with relevant experiments and results.

Personalized Image-based User Authentication using Wearable Cameras

G-PPG: A Gesture-related PPG-based Two-Factor Authentication for Wearable Devices.

M-PPG: A Non-intrusive Authentication for Wearable Devices Via PPG Sensors with Motor Excitations

CamAuth: Securing Web Authentication with Camera

EyeVeri: A secure and usable approach for smartphone user authentication

Whose Move Is It Anyway? Authenticating Smart Wearable Devices Using Unique Head Movement Patterns

Hand-Interactive Behavior Analysis for User Authentication Systems with Wrist-Worn Devices

Motion Trajectory Based Video Authentication

Wearable Wisdom: A Bi-Modal Behavioral Biometric Scheme for Smartwatch User Authentication

Towards Nonintrusive and Secure Mobile Two-Factor Authentication on Wearables

WristAuthen: A Dynamic Time Wrapping Approach for User Authentication by Hand-Interaction through Wrist-Worn Devices

Seeing Red: PPG Biometrics Using Smartphone Cameras

PassFace: Enabling Practical Anti-Spoofing Facial Recognition with Camera Fingerprinting

Adaptive Human-Machine Interactive Behavior Analysis With Wrist-Worn Devices for Password Inference

Where Are the Dots: Hardening Face Authentication on Smartphones with Unforgeable Eye Movement Patterns.

Shake, Shake, I Know Who You Are: Authentication Through Smart Wearable Devices

On the Security of Picture Gesture Authentication.

Your Eyes Reveal Your Secrets: An Eye Movement Based Password Inference on Smartphone

Improving the Authentication with Built-In Camera Protocol Using Built-In Motion Sensors: A Deep Learning Solution

Exploiting multimodal biometrics for enhancing password security

Summary: Multi-modal Biometric-based Implicit Authentication of Wearable Device Users