Abstract:This paper describes a novel method for building affectively intelligent human-interactive agents. The method is based on a key sociological insight that has been developed and extensively verified over the last twenty years, but has yet to make an impact in artificial intelligence. The insight is that resource bounded humans will, by default, act to maintain affective consistency. Humans have culturally shared fundamental affective sentiments about identities, behaviours, and objects, and they act so that the transient affective sentiments created during interactions confirm the fundamental sentiments. Humans seek and create situations that confirm or are consistent with, and avoid and supress situations that disconfirm or are inconsistent with, their culturally shared affective sentiments. This "affect control principle" has been shown to be a powerful predictor of human behaviour. In this paper, we present a probabilistic and decision-theoretic generalisation of this principle, and we demonstrate how it can be leveraged to build affectively intelligent artificial agents. The new model, called BayesAct, can maintain multiple hypotheses about sentiments simultaneously as a probability distribution, and can make use of an explicit utility function to make value-directed action choices. This allows the model to generate affectively intelligent interactions with people by learning about their identity, predicting their behaviours using the affect control principle, and taking actions that are simultaneously goal-directed and affect-sensitive. We demonstrate this generalisation with a set of simulations. We then show how our model can be used as an emotional "plug-in" for artificially intelligent systems that interact with humans in two different settings: an exam practice assistant (tutor) and an assistive device for persons with a cognitive disability.

"AIded with emotions" - a new design approach towards affective computer systems

Analysis and Use of the Emotional Context with Wearable Devices for Games and Intelligent Assistants

Toward a Decision-Theoretic Framework for Affect Recognition and User Assistance

Toward an affect-sensitive multimodal human-computer interaction

Happy Companion : A System of Multimodal Human-Computer Affective Interaction

Affective multimodal human-computer interaction

Emotional Design for Digital Games for Learning: The Affective Quality of Expression, Color, Shape, and Dimensionality of Game Characters.

Design Of Artificial Emotionfor Interactive Agent

Toward Automated Generation of Affective Gestures from Text:A Theory-Driven Approach

Multi-Platform Intelligent System for Multimodal Human-Computer Interaction

These Aren't The Droids You Are Looking for: Promises and Challenges for the Intersection of Affective Science and Robotics/AI

Affective interaction: Using emotions as a user interface in games

Advancing Methodological Approaches in Affect-Adaptive Video Game Design: Empirical Validation of Emotion-Driven Gameplay Modification

Bio-Affective Computer Interface for Game Interaction

Affective Behaviour Analysis via Integrating Multi-Modal Knowledge

Using subjective emotion, facial expression, and gaze direction to evaluate user affective experience and predict preference when playing single-player games

Affect Control Processes: Intelligent Affective Interaction using a Partially Observable Markov Decision Process

Modeling And Application Of Multimodal Affective User Interface With Multimedia

Social-Emotional-Sensory Design Map for Affective Computing Informed by Neurodivergent Experiences

A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications

Artificial Intelligence and Interaction Design for a Positive Emotional User Experience