Abstract:In this work, a Pleasure–Arousal–Dominance (PAD) three-dimensional brain-like emotion generation system is proposed by simulating the brain tissue structures involved in emotion generation in the brain’s limbic system. The system utilizes volatile memristors to simulate the activation and recovery process of neurons, and non-volatile memristors to simulate the synaptic weight changes. It combines the brain emotion learning model and the biological long short-term memory model to simulate the emotion generation process in the brain. The system employs the Dempster–Shafter (D–S) evidence theory for multimodal feature fusion, ultimately representing the generated human-like emotions in the PAD three-dimensional emotion expression space. Considering the differences in emotional information represented in each dimension of the PAD emotion expression space, this work proposes the use of the D–S evidence theory to calculate the weight values of multimodal evidence and each dimension of emotion signals. The system performs weighted summation for multimodal feature fusion, which is more biologically inspired and realistic. As a result, the generated emotion signals are more accurate, and the PAD three-dimensional emotion expression model enhances the capability and richness of emotion expression. The system processes multimodal input signals (text, speech, visual signals) to generate three-dimensional emotion signals (pleasure, arousal, and dominance signals), which correspond to specific emotions in a three-dimensional space. These signals can be visually represented as facial images using MATLAB. The simulation results from PSPICE indicate a nonlinear mapping relationship between the system’s input and output. It shows that different inputs can generate distinct human-like emotions.

PAD Model Based Facial Expression Analysis

Modeling Expressions of Peking Opera Facial Make-Ups

Analysis and Modeling of Affective Audio Visual Speech Based on PAD Emotion Space

Modeling and Editing of Peking Opera Facial Makeup Expressions

Facial Expression Synthesis Using PAD Emotional Parameters for a Chinese Expressive Avatar

Head and Facial Gestures Synthesis Using PAD Model for an Expressive Talking Avatar

Context-Dependent Models for Predicting and Characterizing Facial Expressiveness

Facial Expression Animation Based on Physical Model

Improving the Facial Expression Recognition and Its Interpretability Via Generating Expression Pattern-map

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Modeling the Correlation Between Modality Semantics and Facial Expressions

Emotional Audio-Visual Speech Synthesis Based on PAD

Video Tracked Facial Expression Animation

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

A Facial Expression Model For Human-Like Agent

Facial Expression Synthesis Based on Emotion Dimensions for Affective Talking Avatar

A Novel Dynamic Model Capturing Spatial and Temporal Patterns for Facial Expression Analysis

The Analysis of PAD Emotional State Model Based on Emotion Pictures

A Unified Approach to Facial Affect Analysis: the MAE-Face Visual Representation.

The Study of a Five-Dimensional Emotional Model for Facial Emotion Recognition

Memristive PAD three-dimensional emotion generation system based on D–S evidence theory