Abstract:The context-aware emotional reasoning ability of AI systems, especially in conversations, is of vital importance in applications such as online opinion mining from social media and empathetic dialogue systems. Due to the implicit nature of conveying emotions in many scenarios, commonsense knowledge is widely utilized to enrich utterance semantics and enhance conversation modeling. However, most previous knowledge infusion methods perform empirical knowledge filtering and design highly customized architectures for knowledge interaction with the utterances, which can discard useful knowledge aspects and limit their generalizability to different knowledge sources. Based on these observations, we propose a Bipartite Heterogeneous Graph (BHG) method for enhancing emotional reasoning with commonsense knowledge. In BHG, the extracted context-aware utterance representations and knowledge representations are modeled as heterogeneous nodes. Two more knowledge aggregation node types are proposed to perform automatic knowledge filtering and interaction. BHG-based knowledge infusion can be directly generalized to multi-type and multi-grained knowledge sources. In addition, we propose a Multi-dimensional Heterogeneous Graph Transformer (MHGT) to perform graph reasoning, which can retain unchanged feature spaces and unequal dimensions for heterogeneous node types during inference to prevent unnecessary loss of information. Experiments show that BHG-based methods significantly outperform state-of-the-art knowledge infusion methods and show generalized knowledge infusion ability with higher efficiency. Further analysis proves that previous empirical knowledge filtering methods do not guarantee to provide the most useful knowledge information. Our code is available at: <a class="link-external link-https" href="https://github.com/SteveKGYang/BHG" rel="external noopener nofollow">this https URL</a>.

Constructing the Affective Commonsense Knowledgebase

Building a commonsense knowledge base for context-awareness inference

Affective Common Sense Knowledge Acquisition for Sentiment Analysis.

Enhancing emotion inference in conversations with commonsense knowledge

Dynamic commonsense knowledge fused method for Chinese implicit sentiment analysis

Knowledge Bridging for Empathetic Dialogue Generation

Construction of virtual assistant based on basic emotions theory

Human-like Affective Cognition in Foundation Models

Inference of isA commonsense knowledge with lexical taxonomy

Affective Behaviour Analysis via Integrating Multi-Modal Knowledge

A Bipartite Graph is All We Need for Enhancing Emotional Reasoning with Commonsense Knowledge

Improving Empathetic Dialogue Generation by Dynamically Infusing Commonsense Knowledge.

The Creation of a Chinese Emotion Ontology Based on HowNet

Affect Control Processes: Intelligent Affective Interaction using a Partially Observable Markov Decision Process

Commonsense Generative Model for Chinese Automatic Knowledge Graph Construction

Knowledge-Bridged Causal Interaction Network for Causal Emotion Entailment

Modeling the Experience of Emotion

CARE: Commonsense-Aware Emotional Response Generation with Latent Concepts

A systematic review on affective computing: emotion models, databases, and recent advances

Automatic Expansion of Domain-Specific Affective Models for Web Intelligence Applications

Sweet Apple, company? or food? Adjective-centric commonsense knowledge acquisition with taxonomy-guided induction