Abstract:Although deep learning approaches have achieved performance surpassing humans for still image-based face recognition, unconstrained video-based face recognition is still a challenging task due to large volume of data to be processed and intra/inter-video variations on pose, illumination, occlusion, scene, blur, video quality, etc. In this work, we consider challenging scenarios for unconstrained video-based face recognition from multiple-shot videos and surveillance videos with low-quality frames. To handle these problems, we propose a robust and efficient system for unconstrained video-based face recognition, which is composed of modules for face/fiducial detection, face association, and face recognition. First, we use multi-scale single-shot face detectors to efficiently localize faces in videos. The detected faces are then grouped through carefully designed face association methods, especially for multi-shot videos. Finally, the faces are recognized by the proposed face matcher based on an unsupervised subspace learning approach and a subspace-to-subspace similarity metric. Extensive experiments on challenging video datasets, such as Multiple Biometric Grand Challenge (MBGC), Face and Ocular Challenge Series (FOCS), IARPA Janus Surveillance Video Benchmark (IJB-S) for low-quality surveillance videos and IARPA JANUS Benchmark B (IJB-B) for multiple-shot videos, demonstrate that the proposed system can accurately detect and associate faces from unconstrained videos and effectively learn robust and discriminative features for recognition.

An Automatic System For Multi-View Face Detection And Pose Estimation

An automatic system for multi-view face detection and pose estimation

A statistic-based approach for automatic multi-view face detection and pose estimation

Real-Time Multi-View Face Detection and Pose Estimation Based on Cost-Sensitive AdaBoost

A Real-Time Multi-Task Learning System for Joint Detection of Face, Facial Landmark and Head Pose

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Ensemble SVM Regression Based Multi-View Face Detection System

Real-Time Multi-View Face Detection and Pose Estimation in Video Stream

The Overview of Multi-person Pose Estimation Method

Simultaneous Face Detection And Head Pose Estimation: A Fast And Unified Framework

A robust facial landmark detection method in multi-views

A Survey of Multi-pose Face Recognition

Joint Multi-View Face Alignment in the Wild

Multi-view Segmentation Based on Human Pose Estimation in Images

An Automatic System for Unconstrained Video-Based Face Recognition

A Comprehensive Survey on 2D Multi-Person Pose Estimation Methods

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

Multi-task pose-invariant face recognition.

Fast multi-view face alignment via multi-task auto-encoders

Multi-View Body Structure-Constrainted Human Detection Method

Single-view Multi-Human Pose Estimation by Attentive Cross-Dimension Matching.