Abstract:Multimodal biometric authentication method can conquer the defects of the unimodal biometric authentication technology. In this paper, we design and develop an efficient Android-based multimodal biometric authentication system with face and voice. Considering the hardware performance restriction of the smart terminal, including the random access memory (RAM), central processing unit (CPU) and graphics processor unit (GPU), etc., which cannot efficiently accomplish the tasks of storing and quickly processing the large amount of data, a face detection method is introduced to efficiently discard the redundant background of the image and reduce the unnecessary information. Furthermore, an improved local binary pattern (LBP) coding method is presented to improve the robustness of the extracted face feature. We also improve the conventional endpoint detection technology, i.e. the voice activity detection (VAD) method, which can efficiently increase the detection accuracy of the voice mute and transition information and boost the voice matching effectiveness. To boost the authentication accuracy and effectiveness, we present an adaptive fusion strategy which organically integrates the merits of the face and voice biometrics simultaneously. The cross-validation experiments with public databases demonstrate encouraging authentication performances compared with some state-of-the-art methods. Extensive testing experiments on Android-based smart terminal show that the developed multimodal biometric authentication system achieves perfect authentication effect and can efficiently content the practical requirements.

A NOVEL IDENTITY RECOGNITION SYSTEM BASED ON MOBILE PHONE AND FACE RECOGNITION

LVID: A Multimodal Biometrics Authentication System on Smartphones.

XFace: A Face Recognition System for Android Mobile Phones

Face Biometric Identity Authentication System

Face Authentication System Using the Chinese Second Generation Identity Card

Design and Implementation of Identity Verification Software Based on Deep Learning

Face and Lip-reading Authentication System Based on Android Smart Phones

Multimodal Biometric Authentication System for Smartphone Based on Face and Voice Using Matching Level Fusion

Face identification using reference-based features with message passing model

Design of a Mobile Face Recognition System for Visually Impaired Persons

Android-based Multimodal Biometric Identification System Using Feature Level Fusion

A Speech and Lip Authentication System Based on Android Smart Phone

Face Album: Towards Automatic Photo Management Based on Person Identity on Mobile Phones

A Hybrid Deep Learning System for Real-World Mobile User Authentication Using Motion Sensors

The 2013 Face Recognition Evaluation in Mobile Environment

Face Video Competition

An Efficient Android-Based Multimodal Biometric Authentication System with Face and Voice

Security after login: Identity change detection on smartphones using sensor fusion

Automated Bystander Detection and Anonymization in Mobile Photography

A Face Recognition System Based on Local Binary Patterns and Support Vector Machine for Home Security Service Robot

Design and implementation of liveness detection system based on improved shufflenet V2