Abstract:Deep convolutional neural networks (DCNNs) have achieved human-level accuracy in face identification (Phillips et al., 2018), though it is unclear how accurately they discriminate highly-similar faces. Here, humans and a DCNN performed a challenging face-identity matching task that included identical twins. Participants ( N = 87) viewed pairs of face images of three types: same-identity, general imposters (different identities from similar demographic groups), and twin imposters (identical twin siblings). The task was to determine whether the pairs showed the same person or different people. Identity comparisons were tested in three viewpoint-disparity conditions: frontal to frontal, frontal to 45-degree profile, and frontal to 90-degree-profile. Accuracy for discriminating matched-identity pairs from twin-imposter pairs and general imposter pairs was assessed in each viewpoint-disparity condition. Humans were more accurate for general-imposter pairs than twin-imposter pairs, and accuracy declined with increased viewpoint disparity between the images in a pair. A DCNN trained for face identification (Ranjan et al., 2018) was tested on the same image pairs presented to humans. Machine performance mirrored the pattern of human accuracy, but with performance at or above all humans in all but one condition. Human and machine similarity scores were compared across all image-pair types. This item-level analysis showed that human and machine similarity ratings correlated significantly in six of nine image-pair types [range r = 0.38 to r = 0.63], suggesting general accord between the perception of face similarity by humans and the DCNN. These findings also contribute to our understanding of DCNN performance for discriminating high-resemblance faces, demonstrate that the DCNN performs at a level at or above humans, and suggest a degree of parity between the features used by humans and the DCNN.

Quick Ecognition of Binary Human Face Based on Standard N-tuple Classifier

Human Face Recognition Based on N-tuple Classifie

Weighted Modular 2 DPCA-Based Face Recognition from a Single Sample Image Per Class

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Human Face Recognition Based on Karhunen-Loeve Transform

Cross Models for Twin Recognition.

Gabor Wavelets Transform and Extended Nearest Feature Space Classifier for Face Recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Face identification using reference-based features with message passing model

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

An Intensity and Size Invariant Real Time Face Recognition Approach

New Face Recognition System Based on DCT Pyramid and Backpropagation Neural Network

Human Recognition Using Face in Computed Tomography

A facial aging approach to identification of identical twins

Face Recognition Using Support Vector Machines

Face Recognition Based On Binary Template Matching

Face identification by means of a neural net classifier

Multibiometrics Using a Single Face Image

Twin identification over viewpoint change: A deep convolutional neural network surpasses humans

ICNN: an Inter-class Nearest Neighbor Method for Face Recognition

A Novel Equation based Classifier for Detecting Human in Images