Aspect Level Sentiment Classification with Unbiased Attention and Target Enhanced Representations

Peng Liu,Tingwen Liu,Jinqiao Shi,Xuebin Wang,Zelin Yin,Can Zhao
DOI: https://doi.org/10.1145/3341105.3373869
2020-01-01
Abstract:Aspect-level sentiment classification aims at inferring the sentiment polarities of opinion targets for a given sentence. As a sentence might contain multiple sentiment-target pairs, extracting relevant information concerning the given target entity is the main challenge of this task. We try to overcome the challenge from two aspects. First, the attention mechanism is able to focus on the relevant part of the given entity and is well suited for this task. However, previous attention-based models still suffer from the problem of paying too much attention to sonic sentiment words that arc irrelevant to the target. We call this as attention bias problem. To alleviate the biases, in this work, we introduce an adversarial training method to get unbiased attention. Second, we try to enhance the impact of the target from the perspective of word representations. Thus we propose an Embedding-Preserving Gating (EPGating) Mechanism. The mechanism dynamically incorporates target-related features into word representations as well as retains original word information. The experimental results on SernEval datasets demonstrate the effectiveness of our model.
What problem does this paper attempt to address?