Abstract:The majority of facial recognition systems depend on the accurate location of both the left and right eye centers in an effort to geometrically normalize the face images available in a database under study. In this paper, we propose a novel pupil detection algorithmic approach that automatically and efficiently locates the eye centers of face images captured using visible and infrared sensors when operating under challenging conditions. Our proposed approach includes the usage of long-range and night-time face images captured in the infrared (IR) band under active illumination. It also efficiently deals with partial face obstruction (subjects wearing eye glasses) as well as face pose and illumination variation. Our scenario-adaptable methodological approach involves a number of algorithmic steps, including (i) situation classification (to automatically determine the acquisition scenario each input face image is coming from), (ii) generation and usage of 2D normalized correlation coefficients, (iii) prediction of eye localization, (iv) computation of summation range filters for accurate pupil detection, and an (v) eye glasses classifier on facial images using support vector machines (to determine when subjects are wearing glasses or not). Our proposed approach is compared against state-of-the-art academic and commercial eye detection algorithms, including the (a) Viola and Jones Adaboost method, (b) one of the latest academic eye detection algorithms proposed by Valenti and Gevers (IEEE TPAMI), and (c) the eye detection approach that is available as part of the G8 commercial face recognition software (package provided by L1 systems). Experimental results demonstrate that our proposed approach outperforms all other approaches when applied on various challenging face datasets, including IR face images captured behind tinted glass or at long ranges up to about 350 feet away, day or night. We also show the benefits of our approach to face normalization and, as a result, face recognition improvement performance in terms of rank-1 identification rates. This is an important achievement that has practical value for forensic tool operators who may have to manually localize the eye centers of all face images available in a dataset, before further face image preprocessing and face-based matching algorithms can be applied.

ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environments

PuRe: Robust pupil detection for real-time pervasive eye tracking

PupilNet: Convolutional Neural Networks for Robust Pupil Detection

Robust Video-Based Eye Tracking Using Recursive Estimation of Pupil Characteristics

PupilNet v2.0: Convolutional Neural Networks for CPU based real time Robust Pupil Detection

EPS: Robust Pupil Edge Points Selection with Haar Feature and Morphological Pixel Patterns.

Efficient and robust pupil size and blink estimation from near-field video sequences for human-machine interaction

1000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learning

Robust and accurate pupil detection for head-mounted eye tracking

ESCaF: Pupil Centre Localization Algorithm with Candidate Filtering

Pupil detection method based on ellipse fitting and parameter passing

A Robust Algorithm for Distorted Pupil Localization Based on Ellipse Difference and PSO

A robust and accurate detection of pupil images

On designing an unconstrained tri-band pupil detection system for human identification

Pupil Localisation and Eye Centre Estimation Using Machine Learning and Computer Vision

Pupil Lovalization And Tracking For Video-Based Iris Biometrics

APPD: Adaptive and Precise Pupil Boundary Detection using Entropy of Contour Gradients

A Geometry-Appearance-Based Pupil Detection Method for Near-Infrared Head-Mounted Cameras.

Pupil Detection Based on Oblique Projection Using a Binocular Camera.

Unobtrusive Low Cost Pupil Size Measurements using Web cameras

Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interaction