Abstract:Bayesian inference has been used in the past to model visual perception (Kersten, Mamassian, & Yuille, 2004), accounting for the Helmholtz principle of perception as "unconscious inference" that is constrained by bottom-up sensory evidence (likelihood) while subject to top-down expectation, priming, or other contextual influences (prior bias); here "unconsciousness" merely relates to the "directness" of perception in the sense of Gibson. Here, we adopt the same Bayesian framework to model emotion process in accordance with Schachter-Singer's Two-Factor theory, which argues that emotion is the outcome of cognitive labeling or attribution of a diffuse pattern of autonomic arousal (Schachter & Singer, 1962). In analogous to visual perception, we conceptualize the emotion process as an instance of Bayesian inference, combining the contextual information with a person's physiological arousal patterns. Drift-diffusion models were constructed to simulate emotional processes, where the decision boundaries correspond to the emotional state experienced by the participants, and boundary-crossing constitutes "labeling" in Schachter-Singer's sense. Our model is tested against experimental data from the Schachter & Singer's study (1962) and the Ross et al. study (1969). Two model scenarios are investigated, in which arousal pattern as one factor is pitted against contextual interaction with an confederate (in Schachter-Singer case) or explicitly instructed mis-attribution (in Ross et al. case) as another factor, mapping onto the Bayesian prior (initial position of the drift) and the likelihood function (evidence accumulation or drift rate). We find that the first scenario (arousal as the prior and context as the likelihood) has a better fit with Schachter & Singer (1962) whereas the second scenario (context as the prior and arousal as the likelihood) has a better fit with Ross et al. (1969).

Bayesian Inference Based Temporal Modeling for Naturalistic Affective Expression Classification

Multi-scale Temporal Modeling for Dimensional Emotion Recognition in Video

Modality-invariant Temporal Representation Learning for Multimodal Sentiment Classification

Towards Temporal Modelling of Categorical Speech Emotion Recognition

Affective Expression Analysis in-the-wild using Multi-Task Temporal Statistical Deep Learning Model

Time-Delay Neural Network for Continuous Emotional Dimension Prediction from Facial Expression Sequences.

Efficient Modeling of Long Temporal Contexts for Continuous Emotion Recognition.

A Bayesian Filtering Framework for Continuous Affect Recognition from Facial Images

Multimodal Utterance-level Affect Analysis using Visual, Audio and Text Features

Temporal Modeling Matters: A Novel Temporal Emotional Modeling Approach for Speech Emotion Recognition

Affective Behaviour Analysis via Integrating Multi-Modal Knowledge

Evaluating Temporal Patterns in Applied Infant Affect Recognition

Affective Behaviour Analysis via Progressive Learning

An Effective Ensemble Learning Framework for Affective Behaviour Analysis

Context-Dependent Models for Predicting and Characterizing Facial Expressiveness

A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition

Combining emotional history through multimodal fusion methods.

Causal affect prediction model using a facial image sequence

Modeling emotion in complex stories: the Stanford Emotional Narratives Dataset

A Bayesian Drift-Diffusion Model of Schachter-Singer's Two Factor Theory of Emotion

In-Depth Analysis of Emotion Recognition through Knowledge-Based Large Language Models