Abstract:The complex information processing system of humans generates a lot of objective and subjective evaluations, making the exploration of human cognitive products of great cutting-edge theoretical value. In recent years, deep learning technologies, which are inspired by biological brain mechanisms, have made significant strides in the application of psychological or cognitive scientific research, particularly in the memorization and recognition of facial data. This paper investigates through experimental research how neural networks process and store facial expression data and associate these data with a range of psychological attributes produced by humans. Researchers utilized deep learning model VGG16, demonstrating that neural networks can learn and reproduce key features of facial data, thereby storing image memories. Moreover, the experimental results reveal the potential of deep learning models in understanding human emotions and cognitive processes and establish a manifold visualization interpretation of cognitive products or psychological attributes from a non-Euclidean space perspective, offering new insights into enhancing the explainability of AI. This study not only advances the application of AI technology in the field of psychology but also provides a new psychological theoretical understanding the information processing of the AI. The code is available in here:

What problem does this paper attempt to address?

This paper discusses the posterior interpretation analysis of facial expressions and psychological traits data based on deep learning. The study explores how neural networks process and store facial expression data through experiments and associates them with various psychological attributes generated by humans. By using the deep learning model VGG16, it is demonstrated that neural networks can learn and reproduce key features of facial data, thereby storing image memory. In addition, the experimental results show the potential of deep learning models in understanding human emotions and cognitive processes, and establish a manifold visualization explanation of cognitive products or psychological attributes from a non-Euclidean space perspective, providing a new perspective for enhancing the interpretability of AI. The paper points out that although deep learning has achieved some results in the field of psychology, the lack of decision transparency challenges the technical boundaries and touches on the fundamental question of how to use these technologies to simulate, understand, and enhance human psychological processes. The study uses posterior explanation algorithms such as LIME, SHAP, and Grad-CAM to explain how input data affects the model's predicted output. The paper also uses manifold learning algorithms to reveal the inherent relationship between facial expression image data and psychological variable data in neural networks. Specific contributions include: 1. Achieving state-of-the-art results in the Wilma Bainbridge 10k US Adult Faces database using VGG16. 2. Linking psychological variables to facial features through Grad-CAM. 3. Using explanation algorithms such as t-SNE and UMAP to interpret the internal patterns of psychological attributes predicted by neural networks, providing new research approaches for AI in the field of psychology. The study found that although deep learning models perform well in predicting certain psychological attributes, they have not completely revealed the deep causal rules and may not fully capture the complexity and interdependence of psychological attributes. Therefore, future research needs to further improve the transparency and theoretical framework of the models to better understand and explain complex decision-making processes.

Post-hoc and manifold explanations analysis of facial expression data based on deep learning

Unveiling the human-like similarities of automatic facial expression recognition: An empirical exploration through explainable ai

Identifying individual facial expressions by deconstructing a neural network

Deep learning reveals what facial expressions mean to people in different cultures

Predicting and visualizing psychological attributions with a deep neural network

A Deep Learning Perspective on the Origin of Facial Expressions

Facial Expression Recognition from a Single Face Image Based on Deep Learning and Broad Learning

Facial Expression Synthesis Using Manifold Learning and Belief Propagation

Facial expression recognition based on deep learning

A Comprehensive Survey on Predicting Human Psychological State through Facial Feature Analysis

Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods

Facial Emotions Recognition Using Deep Learning Technology

Enhancing Facial Emotion Recognition with a Modified Deep Convolutional Neural Network

A survey of facial expression recognition based on deep learning

Learning via social awareness: Improving a deep generative sketching model with facial feedback

Spontaneous Facial Expressions and Micro-expressions Coding: From Brain to Face

A Survey of Deep Facial Attribute Analysis

A descriptive human visual cognitive strategy using graph neural network for facial expression recognition

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Fine-Grained Facial Expression Analysis Using Dimensional Emotion Model