Relational Graph Convolutional Networks for Sentiment Analysis

Asal Khosravi,Zahed Rahmati,Ali Vefghi

2024-04-16

Abstract:With the growth of textual data across online platforms, sentiment analysis has become crucial for extracting insights from user-generated content. While traditional approaches and deep learning models have shown promise, they cannot often capture complex relationships between entities. In this paper, we propose leveraging Relational Graph Convolutional Networks (RGCNs) for sentiment analysis, which offer interpretability and flexibility by capturing dependencies between data points represented as nodes in a graph. We demonstrate the effectiveness of our approach by using pre-trained language models such as BERT and RoBERTa with RGCN architecture on product reviews from Amazon and Digikala datasets and evaluating the results. Our experiments highlight the effectiveness of RGCNs in capturing relational information for sentiment analysis tasks.

Computation and Language,Machine Learning

What problem does this paper attempt to address?

The paper aims to address a problem in the field of sentiment analysis, specifically how to more effectively extract sentiment information from textual data. Specifically, the issues the paper focuses on include:

1. **Limitations of traditional methods and deep learning models**: Existing methods, while showing some effectiveness, are inadequate in capturing the complex relationships between entities in the text.

2. **Interpretability issues**: Deep learning models are often viewed as "black boxes," making it difficult to explain their internal workings, especially in terms of weight allocation and feature space dimensions.

To address the above issues, the paper proposes a new approach, namely using Relational Graph Convolutional Networks (RGCNs) for sentiment analysis. This method represents textual data by constructing a heterogeneous graph and considers different types of edges to capture the complex relationships between entities, thereby improving the model's interpretability and flexibility. The main contributions of the paper can be summarized as follows:

- **Methodological innovation**: The paper proposes applying RGCNs to sentiment analysis tasks, utilizing this network structure to better understand the relationships between entities in the text.

- **Integration of pre-trained language models**: The paper combines pre-trained language models (such as BERT and RoBERTa) with the RGCN architecture, further enhancing the model's ability to extract meaningful sentiment features from documents.

- **Experimental validation**: The effectiveness of the proposed method is demonstrated through experimental results on two different datasets (Amazon product reviews and Digikala product reviews), and it is compared with existing methods, proving the superiority of RGCN in capturing relational information.

In summary, the paper attempts to improve sentiment analysis tasks by introducing RGCNs and pre-trained language models to address the limitations of traditional methods and deep learning models in processing textual data.