Deep learning detects subtle facial expressions in a multilevel society primate
Gu FANG,Xianlin PENG,Penglin XIE,Jun REN,Shenglin PENG,Xiaoyi FENG,Xin TIAN,Mingzhu ZHOU,Zhibo LI,Jinye PENG,Tetsuro MATSUZAWA,Zhaoqiang XIA,Baoguo LI
DOI: https://doi.org/10.1111/1749-4877.12905
2024-10-02
Integrative Zoology
Abstract:First discovery of unrecognized animal subtle facial expressions. Reveals the complexity of nonhuman primate facial expressions. Novel application of artificial intelligence (AI) for primate facial expression analysis. Superiority of AI over human recognition: accuracy, speed, and robustness. Insights into animal social system evolution through facial expressions. Facial expressions in nonhuman primates are complex processes involving psychological, emotional, and physiological factors, and may use subtle signals to communicate significant information. However, uncertainty surrounds the functional significance of subtle facial expressions in animals. Using artificial intelligence (AI), this study found that nonhuman primates exhibit subtle facial expressions that are undetectable by human observers. We focused on the golden snub‐nosed monkeys (Rhinopithecus roxellana), a primate species with a multilevel society. We collected 3427 front‐facing images of monkeys from 275 video clips captured in both wild and laboratory settings. Three deep learning models, EfficientNet, RepMLP, and Tokens‐To‐Token ViT, were utilized for AI recognition. To compare the accuracy of human performance, two groups were recruited: one with prior animal observation experience and one without any such experience. The results showed human observers to correctly detect facial expressions (32.1% for inexperienced humans and 45.0% for experienced humans on average with a chance level of 33%). In contrast, the AI deep learning models achieved significantly higher accuracy rates. The best‐performing model achieved an accuracy of 94.5%. Our results provide evidence that golden snub‐nosed monkeys exhibit subtle facial expressions. The results further our understanding of animal facial expressions and also how such modes of communication may contribute to the origin of complex primate social systems.
zoology