Knowledge Graph Enhanced Aspect-Level Sentiment Analysis

Kavita Sharma,Ritu Patel,Sunita Iyer
2024-01-27
Abstract:In this paper, we propose a novel method to enhance sentiment analysis by addressing the challenge of context-specific word meanings. It combines the advantages of a BERT model with a knowledge graph based synonym data. This synergy leverages a dynamic attention mechanism to develop a knowledge-driven state vector. For classifying sentiments linked to specific aspects, the approach constructs a memory bank integrating positional data. The data are then analyzed using a DCGRU to pinpoint sentiment characteristics related to specific aspect terms. Experiments on three widely used datasets demonstrate the superior performance of our method in sentiment classification.
Computation and Language
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper aims to address the challenges posed by context-dependent word meanings in sentiment analysis. Specifically, it proposes a novel approach to enhance sentiment analysis by combining the advantages of the BERT model with synonym data based on a knowledge graph. This method utilizes a dynamic attention mechanism to develop a knowledge-driven state vector and constructs a memory bank to integrate positional information. The data is analyzed using a Dual-Channel Gated Recurrent Unit (DCGRU) to locate specific sentiment features related to particular aspects. Experimental results show that this method demonstrates superior sentiment classification performance on three widely used datasets. ### Method Overview The paper proposes an aspect-oriented text sentiment analysis method based on knowledge graphs and DCGRU. The method includes the following components: 1. **Input Text Word Embedding Layer**: Converts text into word vectors. 2. **Word Encoding Layer**: Captures semantic dependencies. 3. **Encoding Layer with Integrated Knowledge Module**: Models synonyms and text information from the knowledge graph. 4. **Text Representation with Positional Attention Information**: Models the positional information of words and calculates each word's contribution to text sentiment classification. 5. **Aspect-Oriented Sentiment Feature Representation Based on DCGRU**: Calculates the attention score of each memory content and extracts text features through a threshold control unit. 6. **Output Layer**: Outputs the sentiment classification results of the text. ### Experiments and Results Analysis #### Experimental Datasets and Settings Experiments were conducted on three publicly standard datasets: the Restaurant and Laptop datasets from Semeval 2014 Task 4, and a Twitter domain dataset collected by Dong et al. These datasets all contain three sentiment polarity labels: positive, negative, and neutral. #### Evaluation Metrics The paper uses Accuracy (ACC) and Macro-F1 as experimental evaluation metrics to measure the overall experimental effect. #### Comparison Methods The paper compares multiple methods, including: 1. SVM: Extracts a series of features and has achieved good results on Semeval 2014 Task 4. 2. LSTM: Uses LSTM to compute sentence feature representations. 3. TD-LSTM: Uses two connected LSTM networks to represent and predict sentiment polarity. 4. Atae-LSTM: Appends aspect words after each word to enhance the influence of aspect words on text sentiment polarity prediction. 5. Ian: Designs an attention mechanism to interactively learn context and aspect word representations. 6. Memnet: Uses multi-layer shared parameter computation layers, with each layer based on context information and positional attention. 7. Ram: Improves MemNet by constructing memory blocks and using a threshold control unit to non-linearly combine multiple attention output sentences. 8. Cabasc: Uses a sentence-level attention mechanism to capture key information for a given aspect globally and considers word and related order through a context attention mechanism. 9. Syntax-based Hybrid Attention Network: Uses a global attention mechanism to capture coarse information about aspects and a syntax-guided local attention mechanism to observe words close to the aspects. #### Performance Comparison To verify the effectiveness of the method, the paper presents the ACC and MacF1 values of each method on the three datasets. The results show that the proposed KG-ALSA method achieves the best results on all datasets. Compared to other methods, KG-ALSA better describes the semantic information of words in the current context by dynamically measuring the influence of synonym information in the knowledge graph on the current information, providing finer-grained sentiment classification features, thereby further improving performance.