Abstract:This paper describes a novel method for building affectively intelligent human-interactive agents. The method is based on a key sociological insight that has been developed and extensively verified over the last twenty years, but has yet to make an impact in artificial intelligence. The insight is that resource bounded humans will, by default, act to maintain affective consistency. Humans have culturally shared fundamental affective sentiments about identities, behaviours, and objects, and they act so that the transient affective sentiments created during interactions confirm the fundamental sentiments. Humans seek and create situations that confirm or are consistent with, and avoid and supress situations that disconfirm or are inconsistent with, their culturally shared affective sentiments. This "affect control principle" has been shown to be a powerful predictor of human behaviour. In this paper, we present a probabilistic and decision-theoretic generalisation of this principle, and we demonstrate how it can be leveraged to build affectively intelligent artificial agents. The new model, called BayesAct, can maintain multiple hypotheses about sentiments simultaneously as a probability distribution, and can make use of an explicit utility function to make value-directed action choices. This allows the model to generate affectively intelligent interactions with people by learning about their identity, predicting their behaviours using the affect control principle, and taking actions that are simultaneously goal-directed and affect-sensitive. We demonstrate this generalisation with a set of simulations. We then show how our model can be used as an emotional "plug-in" for artificially intelligent systems that interact with humans in two different settings: an exam practice assistant (tutor) and an assistive device for persons with a cognitive disability.

Advances of Research in Affective Processes in Communication and Collaboration

An Experimental Study on Individual and Group Affect in Multi-Tasking Teams.

Expanding the Role of Affective Phenomena in Multimodal Interaction Research

These Aren't The Droids You Are Looking for: Promises and Challenges for the Intersection of Affective Science and Robotics/AI

Proceedings of 2011 International Workshop on Ubiquitous Affective Awareness and Intelligent Interaction

Affective Conversational Agents: Understanding Expectations and Personal Influences

Affect and Trust in Technology in Teams

Emotions and Affect in Human Factors and Human–Computer Interaction: Taxonomy, Theories, Approaches, and Methods

Toward an affect-sensitive multimodal human-computer interaction

Affect and Trust in Technology in Teams: The Effect of Incidental Affect and Integral Affect

Affective multimodal human-computer interaction

Affective Haptics Research and Interaction Design.

Ubiquitous Affective Awareness And Intelligent Interaction 2011

Affective Haptics and Multimodal Experiments Research

Review and Perspectives on Human Emotion for Connected Automated Vehicles

The Importance of Multimodal Emotion Conditioning and Affect Consistency for Embodied Conversational Agents

Fuzzy Sets and Systems in Building Closed-Loop Affective Computing Systems for Human-Computer Interaction: Advances and New Research Directions

Guest Editorial: Ethics in Affective Computing

Past, Present, and Future: A Survey of The Evolution of Affective Robotics For Well-being

Affect Control Processes: Intelligent Affective Interaction using a Partially Observable Markov Decision Process

Needs and challenges in human computer interaction for processing social emotional information