Abstract:Dynamic emotion is typically used to facilitate human–machine interactions. Conversational data from social media contain a considerable amount of useful information, and such data are the foundation for researching dynamic and artificial emotion. At present, most human–machine interaction systems focus on the complexity and accuracy of the dialog but neglect the emotional characteristics of the speaker. When generating a dialog considering the emotional personality of the interlocutor, controlling, and guiding the dialog to a specified direction are essential. This article presents a system for studying dynamic emotions in human-computer interaction from the perspective of emotional transfer and guidance. Based on the emotional state of the interlocutor and the distribution of emotional transfer, the process of emotional transfer is simulated and sampled, and the sequence of emotional guidance is generated. In this system, two algorithms are proposed. A generative Markov chain Monte Carlo (GEN-MCMC) algorithm is proposed to generate a variety of emotional transfer sequences that fit the talke’s personality dynamically based on the real-world dialog. Further, a guiding MCMC (GUI-MCMC) algorithm-based GEN-MCMC is proposed to generate the emotional guiding sequences. The generated emotional sequences by GEN-MCMC were evaluated in two aspects: 1) consistency and 2) diversity. The experimental results show that the GEN-MCMC algorithm performs better than the general sequence generation algorithm in terms of consistency and diversity in generating emotional states. The GUI-MCMC was able to generate a proper stimulus sequence when given the first and target emotions. An emotional stimulus sequence can simulate the emotional transfer of the interlocutor in the process of dialogue, and give the observer appropriate reference to guide and control the emotions of dialogue. The experimental results show that the proposed system can effectively model the dynamic emotion in emotional transfer and guidance, which can be further used to build chat robots, intelligent assistants, and human–machine interaction systems. The models can also be used for emotional induction and enhance the feel-good or feel-terrible factor in human–machine communication applications, such as medical treatment of mental diseases, interrogation, and psychological attack and defense.

Virtual Human System with Ability of Emotion and Speech Interaction

Construction of virtual assistant based on basic emotions theory

Happy Companion : A System of Multimodal Human-Computer Affective Interaction

Design and Analysis of a Human–Machine Interaction System for Researching Human’s Dynamic Emotion

Designing and Evaluating an Emotionally Responsive Virtual Patient Simulation

A Multimodal Emotional Communication Based Humans-Robots Interaction System

Multimodal emotion estimation and emotional synthesize for interaction virtual agent

Developing conversational Virtual Humans for social emotion elicitation based on large language models

Study on Artificial Emotion and Its Application in the Behavior Selection Strategy of Agents

Emotional Talking Agent: System and Evaluation

The design of expressive intelligent agent for human-computer interaction

Using Virtual Humans to Understand Real Ones

Multi-Modal Based Fuzzy Atmosfield in Human-Robot Interaction

Toward an affect-sensitive multimodal human-computer interaction

Modeling And Application Of Multimodal Affective User Interface With Multimedia

Emotional Chinese talking head system

Analysis and Calculation on Human-Computer Interaction System of Emotion

Affective multimodal human-computer interaction

Emotional States Based 3-D Fuzzy Atmosfield for Casual Communication Between Humans and Robots

A Framework of Online Learning and Experiment System Based on Affective Computing

A Multi-modal Eliza Using Natural Language Processing and Emotion Recognition