Abstract:There is an increasing interest in developing intelligent human–computer interaction systems that can fulfill two functions—recognizing user affective states and providing the user with timely and appropriate assistance. In this paper, we present a general unified decision-theoretic framework based on influence diagrams for simultaneously modeling user affect recognition and assistance. Affective state recognition is achieved through active probabilistic inference from the available multi modality sensory data. User assistance is automatically accomplished through a decision-making process that balances the benefits of keeping the user in productive affective states and the costs of performing user assistance. We discuss three theoretical issues within the framework, namely, user affect recognition, active sensory action selection, and user assistance. Validation of the proposed framework via a simulation study demonstrates its capability in efficient user affect recognition as well as timely and appropriate user assistance. Besides the theoretical contributions, we build a non-invasive real-time prototype system to recognize different user affective states (stress and fatigue) from four-modality user measurements, namely physical appearance features, physiological measures, user performance, and behavioral data. The affect recognition component of the prototype system is subsequently validated through a real-world study involving human subjects.

The Research on User Modeling for Personalized Affective Computing

Building an Affective Model for Social Robots with Customizable Personality.

A Multi-layer Affective Model Based on Personality,Mood and Emotion

Research on the Personalized Interaction Model Driven by User Behavior

A Survey on Personalized Affective Computing in Human-Machine Interaction

A new layered model of affect

A Mind Model for an Affective Computer

Research on a Model of Emotion for Virtual Agent

Affective transfer computing model based on attenuation emotion mechanism

A Computational Model of Emotion Based on Audio-Visual Stimuli Understanding and Personalized Regulation with Concurrency

Toward a Decision-Theoretic Framework for Affect Recognition and User Assistance

Incorporating Emotion and Personality-Based Analysis in User-Centered Modelling

Personality Enhanced Emotion Generation Modeling for Dialogue Systems

Study of Virtual Human Affective Interactive Technology

A Preliminary Research of Chinese Emotion Classification Model

Research on Affective Model of Affective Robot

Modeling And Application Of Multimodal Affective User Interface With Multimedia

Research on Multi-modal Affective Assistant Model in Online Synchronous Teaching

Research of Affective Computing in Intelligent Virtual Environment

Emotional expression system based on expression intensity recognition and affective model

An Affective Model of Artificial Psychology