Abstract:Deep convolutional neural networks (DCNNs) have achieved human-level accuracy in face identification (Phillips et al., 2018), though it is unclear how accurately they discriminate highly-similar faces. Here, humans and a DCNN performed a challenging face-identity matching task that included identical twins. Participants ( N = 87) viewed pairs of face images of three types: same-identity, general imposters (different identities from similar demographic groups), and twin imposters (identical twin siblings). The task was to determine whether the pairs showed the same person or different people. Identity comparisons were tested in three viewpoint-disparity conditions: frontal to frontal, frontal to 45-degree profile, and frontal to 90-degree-profile. Accuracy for discriminating matched-identity pairs from twin-imposter pairs and general imposter pairs was assessed in each viewpoint-disparity condition. Humans were more accurate for general-imposter pairs than twin-imposter pairs, and accuracy declined with increased viewpoint disparity between the images in a pair. A DCNN trained for face identification (Ranjan et al., 2018) was tested on the same image pairs presented to humans. Machine performance mirrored the pattern of human accuracy, but with performance at or above all humans in all but one condition. Human and machine similarity scores were compared across all image-pair types. This item-level analysis showed that human and machine similarity ratings correlated significantly in six of nine image-pair types [range r = 0.38 to r = 0.63], suggesting general accord between the perception of face similarity by humans and the DCNN. These findings also contribute to our understanding of DCNN performance for discriminating high-resemblance faces, demonstrate that the DCNN performs at a level at or above humans, and suggest a degree of parity between the features used by humans and the DCNN.

Deep Convolutional Neural Network Using Triplet Loss to Distinguish the Identical Twins.

A Loss Combination Based Deep Model for Person Re-Identification

Triplet Distillation for Deep Face Recognition

People Re-identification Using Deep Convolutional Neural Network.

Benchmarking human face similarity using identical twins

Cross Models for Twin Recognition.

Body Structure Based Triplet Convolutional Neural Network For Person Re-Identification

Person Re-identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function

Multi-stage Deep Convolutional Learning for People Re-Identification

Twin identification over viewpoint change: A deep convolutional neural network surpasses humans

Person Re-Identification by the Asymmetric Triplet and Identification Loss Function

Learning Deep Features with Adaptive Triplet Loss for Person Reidentification

A facial aging approach to identification of identical twins

Compact Triplet Loss for Person Re-Identification in Camera Sensor Networks

Deep Image Similarity Measurement Based on the Improved Triplet Network with Spatial Pyramid Pooling.

An Efficient Deep Neural Networks Training Framework for Robust Face Recognition

Twins 3D Face Recognition Challenge

Deep Difference Analysis In Similar-Looking Face Recognition

Jointly Learning Shape Descriptors and Their Correspondence Via Deep Triplet CNNs

Multitask learning and CNN for application of face recognition.

Deep Feature Learning with Relative Distance Comparison for Person Re-Identification.