Abstract:Aspect-level sentiment classification aims to integrating the context to predict the sentiment polarity of aspect-specific in a text, which has been quite useful and popular, e.g., opinion survey and products’ recommending in e-commerce. Many recent studies exploit a Long Short-Term Memory (LSTM) networks to perform aspect-level sentiment classification, but the limitation of long-term dependencies is not solved well, so that the semantic correlations between each two words of the text are ignored. In addition, traditional classification model adopts SoftMax function based on probability statistics as classifier, but ignores the words’ features in the semantic space. Support Vector Machine (SVM) can fully use the information of characteristics, and it is appropriate to make classification in the high-dimensional space, however, which just considers the maximum distance between different classes and ignores the similarities between different features of the same classes. To address these defects, we propose the two-stage novel architecture named Self Attention Networks and Adaptive SVM (SAN-ASVM) for aspect-level sentiment classification. In the first stage, in order to overcome the long-term dependencies, Multi-HeadsSelf Attention (MHSA) mechanism is applied to extract the semantic relationships between each two words; furthermore, 1-hop attention mechanism is designed to pay more attention on some important words related to aspect-specific. In the second stage, ASVM is designed to substitute the SoftMax function to perform sentiment classification, which can effectively make multi-classifications in high-dimensional space. Extensive experiments on SemEval2014, SemEval2016 and Twitter datasets are conducted, and compared experiments prove that SAN-ASVM model can obtain better performance.

Aspect-Level Sentiment Classification Based on Self-Attention Routing Via Capsule Network.

Aspect-level Sentiment Analysis Using AS-Capsules

Dual Edge-embedding Graph Convolutional Network for Unified Aspect-based Sentiment Analysis

A Relative Position Attention Network for Aspect-Based Sentiment Analysis

Discovering Protagonist of Sentiment with Aspect Reconstructed Capsule Network

A Sparse Self-Attention Enhanced Model for Aspect-Level Sentiment Classification

TransCapsule Model for Sentiment Classification

Joint Learning of Local and Global Features for Aspect-based Sentiment Classification

Attention-based LSTM for Aspect-level Sentiment Classification.

Targeted Aspect-Based Multimodal Sentiment Analysis: An Attention Capsule Extraction and Multi-Head Fusion Network

Position-Enhanced Multi-Head Self-Attention Based Bidirectional Gated Recurrent Unit for Aspect-Level Sentiment Classification

Aspect-based Sentiment Analysis Model Based on Multi-hop Information

Self-Attention Networks and Adaptive Support Vector Machine for aspect-level sentiment classification

A Memory-Driven Neural Attention Model for Aspect-Based Sentiment Classification

Aspect-Pair Supervised Contrastive Learning for aspect-based sentiment analysis

Aspect-Level Sentiment Analysis Based on Lite Bidirectional Encoder Representations From Transformers and Graph Attention Networks

Aspect Sentiment Classification with Both Word-level and Clause-level Attention Networks.

A Hybrid Semantics and Syntax-Based Graph Convolutional Network for Aspect-Level Sentiment Classification

Content Attention Model for Aspect Based Sentiment Analysis

Graph Convolution over the Semantic-syntactic Hybrid Graph Enhanced by Affective Knowledge for Aspect-level Sentiment Classification

Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks