Syntactic Fusion: Enhancing Aspect-Level Sentiment Analysis Through Multi-Tree Graph Integration

Jane Sunny,Tom Padraig,Roggie Terry,Woods Ali
2023-11-28
Abstract:Recent progress in aspect-level sentiment classification has been propelled by the incorporation of graph neural networks (GNNs) leveraging syntactic structures, particularly dependency trees. Nevertheless, the performance of these models is often hampered by the innate inaccuracies of parsing algorithms. To mitigate this challenge, we introduce SynthFusion, an innovative graph ensemble method that amalgamates predictions from multiple parsers. This strategy blends diverse dependency relations prior to the application of GNNs, enhancing robustness against parsing errors while avoiding extra computational burdens. SynthFusion circumvents the pitfalls of overparameterization and diminishes the risk of overfitting, prevalent in models with stacked GNN layers, by optimizing graph connectivity. Our empirical evaluations on the SemEval14 and Twitter14 datasets affirm that SynthFusion not only outshines models reliant on single dependency trees but also eclipses alternative ensemble techniques, achieving this without an escalation in model complexity.
Computation and Language
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that in aspect - level sentiment classification tasks, the existing dependency - tree - based methods are vulnerable to the influence of parsing algorithm errors, resulting in a decline in model performance. Specifically, the paper points out: 1. **Dependency Tree Parsing Errors**: Existing methods usually rely on the dependency trees generated by a single parser. However, these parsers may make mistakes when processing texts in different domains, thus affecting the accuracy of sentiment analysis. 2. **Model Over - Parameterization and Overfitting**: In order to improve the performance of the model, some methods use multi - layer graph neural networks (GNN), but this may lead to model over - parameterization and overfitting, especially when the amount of data is limited. To solve these problems, the paper proposes **SynthFusion**, an innovative graph integration method. It enhances the model's robustness to parsing errors by fusing the dependency trees generated by multiple parsers and avoids adding additional computational burdens. Specifically, the main contributions of SynthFusion include: - **Fusing Multiple Dependency Trees**: By integrating the dependency trees generated by multiple parsers, SynthFusion can consider multiple parsing hypotheses simultaneously during the model training process, thereby improving the model's decision - making ability. - **Maintaining Syntactic Dependency Relations**: By classifying edges into parent - to - child and child - to - parent types and applying the Relational Graph Attention Network (RGAT), SynthFusion preserves the syntactic dependency relations of the original dependency trees. - **Reducing Model Complexity**: By introducing more edges and reducing the diameter of the graph, SynthFusion avoids the risks of model over - parameterization and overfitting, enabling the use of shallower GNN models, thereby preventing the over - smoothing problem in deep networks. The paper verifies the effectiveness of SynthFusion through experiments on the SemEval 2014 and Twitter 14 datasets. The results show that SynthFusion is not only superior to models relying on a single dependency tree but also outperforms other integration techniques without increasing model complexity.