Abstract:The majority of facial recognition systems depend on the accurate location of both the left and right eye centers in an effort to geometrically normalize the face images available in a database under study. In this paper, we propose a novel pupil detection algorithmic approach that automatically and efficiently locates the eye centers of face images captured using visible and infrared sensors when operating under challenging conditions. Our proposed approach includes the usage of long-range and night-time face images captured in the infrared (IR) band under active illumination. It also efficiently deals with partial face obstruction (subjects wearing eye glasses) as well as face pose and illumination variation. Our scenario-adaptable methodological approach involves a number of algorithmic steps, including (i) situation classification (to automatically determine the acquisition scenario each input face image is coming from), (ii) generation and usage of 2D normalized correlation coefficients, (iii) prediction of eye localization, (iv) computation of summation range filters for accurate pupil detection, and an (v) eye glasses classifier on facial images using support vector machines (to determine when subjects are wearing glasses or not). Our proposed approach is compared against state-of-the-art academic and commercial eye detection algorithms, including the (a) Viola and Jones Adaboost method, (b) one of the latest academic eye detection algorithms proposed by Valenti and Gevers (IEEE TPAMI), and (c) the eye detection approach that is available as part of the G8 commercial face recognition software (package provided by L1 systems). Experimental results demonstrate that our proposed approach outperforms all other approaches when applied on various challenging face datasets, including IR face images captured behind tinted glass or at long ranges up to about 350 feet away, day or night. We also show the benefits of our approach to face normalization and, as a result, face recognition improvement performance in terms of rank-1 identification rates. This is an important achievement that has practical value for forensic tool operators who may have to manually localize the eye centers of all face images available in a dataset, before further face image preprocessing and face-based matching algorithms can be applied.

A Geometry-Appearance-Based Pupil Detection Method for Near-Infrared Head-Mounted Cameras.

Gaze Tracking System Based on Pupil Detection

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

Robust and accurate pupil detection for head-mounted eye tracking

On designing an unconstrained tri-band pupil detection system for human identification

Planar Gaze Parameter Detection in Gaze Tracking System with Active Infrared Light Source

Pupil detection method based on ellipse fitting and parameter passing

Robust Real-Time Multi-User Pupil Detection and Tracking under Various Illumination and Large-Scale Head Motion

Pupil Detection Based on Oblique Projection Using a Binocular Camera.

A Fast and Accurate Pupil Localization Method Using Gray Gradient Differential and Curve Fitting

Head Mounted Pupil Tracking Using Convolutional Neural Network

A robust and accurate detection of pupil images

Head Pose-Aware Regression for Pupil Localization From a-Pillar Cameras

Eye Gaze Tracking Based on Dark Pupil Image

PupilNet: Convolutional Neural Networks for Robust Pupil Detection

A Robust Coarse-to-Fine Method for Pupil Localization in Non-ideal Eye Images

Human Eyes Detection and Pupil Localization

Pupil Localization for Multi-View Eyeballs by ASM and Eye Gray Distribution

Event Camera-Based Pupil Localization: Facilitating Training With Event-Style Translation of RGB Faces

A Novel Eye Gaze Tracking Technique Based on Pupil Center Cornea Reflection Technique

Pupil-Contour-Based Gaze Estimation with Real Pupil Axes for Head-Mounted Eye Tracking