Face detection from patterns of shading and shadows: The role of overhead illumination in generating the familiar appearance of the human face

Colin J Palmer,Erin Goddard,Colin W G Clifford

DOI: https://doi.org/10.1016/j.cognition.2022.105172

IF: 4.011

Cognition

Abstract:Face detection in human vision relies on a stereotypical pattern of visual features common to different faces. How are these visual features generated in the environment? Here we investigate how characteristic patterns of shading and shadows that occur across the face act as a cue for face detection. We use 3D rendering to isolate facial shading under simulated lighting conditions, comparing the broad patterns of contrast that occur across the face when light arrives from different angles. We find that human performance in discriminating faces from non-face objects using these contrast patterns depends strongly on the lighting direction. In particular, light arriving from above the brow tends to facilitate face detection - consistent with the statistics of real-world lighting environments, in which light commonly arrives more strongly from above. Indeed, in a further experiment, we find that asymmetries in lighting that occur in complex and naturalistic lighting environments produce contrast patterns across the face that facilitate face detection. These effects occurred independent of the lighting direction relative to the viewer, suggesting that cues to face detection emerge from the interaction between face morphology and vertical asymmetries in lighting direction, independent of the viewer's knowledge or expectations about lighting direction. Comparison with the performance of an image classifier suggests that the effects of lighting direction partly reflect differences in image information that result from the interaction between shape and illumination, as well as face detection in human observers being better-tuned to the pattern of shading and shadows that occurs across an upright face that is lit from overhead.