Abstract:Aspect-Based Sentiment Classification (ABSA), predicting the sentimental tendency towards given aspects, is an important branch in natural language understanding. However, in the existing deep learning models for ABSA, there is a contradiction between the fine sentiment analysis and the small amount of corpus. To solve this contradiction, we propose a BERT-based Multi-Semantic Learning (BERT-MSL) model with aspect-aware enhancement for aspect polarity classification, which follows the Transformer structure in BERT and uses lightweight multi-head self-attentions for encoding. First, we make full use of the extensive pre-training and post-training of the BERT model to obtain the initialization parameters with rich knowledge for our BERT-MSL model, so that our model can be quickly adapted to the ABSA task only by fine-tuning on a small corpus. Second, to achieve the fine sentiment analysis centered on aspect target, we propose a BERT-based multi-semantic learning model composed of the left-side local semantic, right-side local semantic, aspect target semantic and global semantic learning modules, and propose an aspect-aware enhancement method based on BERT and multi-head attention. Third, we propose two alternative semantic merging methods to generate the final expressive-powerful sentiment semantics for ABSA. Furthermore, to expand the application scope of our model, we design an advanced structure for our model by introducing a CNN-based semantic refinement layer. Experimental results on five SemEval and Twitter datasets demonstrate that our model improves the stability and robustness of ABSA and significantly outperforms some of the state-of-the-art models under the BERT Post-Training (BERT-PT) environment.

BERT-IAN Model for Aspect-based Sentiment Analysis

Aspect-Level Sentiment Analysis Approach via BERT and Aspect Feature Location Model

Interactive Attention Networks for Aspect-Level Sentiment Classification

Aspect-Context Interactive Attention Representation for Aspect-Level Sentiment Classification

An improved aspect-category sentiment analysis model for text sentiment analysis based on RoBERTa

Methods to Enhance BERT in Aspect-Based Sentiment Classification

Sentiment Knowledge-Induced Neural Network for Aspect-Level Sentiment Analysis.

Utilizing BERT Intermediate Layers for Aspect Based Sentiment Analysis and Natural Language Inference

A BERT-based multi-semantic learning model with aspect-aware enhancement for aspect polarity classification

An Aspect Level Sentiment Analysis Based on Embedding Tuning & Attention Neural Network

Effective Self Attention Modeling for Aspect Based Sentiment Analysis.

A Neural Model for Aspect-Level Sentiment Classification of Product Reviews Assissted by Question-Answering

Improving Cross-Domain Aspect-Based Sentiment Analysis using Bert-BiLSTM Model and Dual Attention Mechanism

Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa

MAN: Mutual Attention Neural Networks Model for Aspect-Level Sentiment Classification in SIoT

Aspect-Level Sentiment Analysis Based on Lite Bidirectional Encoder Representations From Transformers and Graph Attention Networks

Aspect-level Sentiment Classification Based on Aspect-Oriented Information and Inter-Aspect Relations

Research on Aspect-Level Sentiment Analysis Based on Adversarial Training and Dependency Parsing

Aspect Based Sentiment Analysis of catering field reviews via RoBERTa-AOA model

End-to-End Aspect-Based Sentiment Analysis Based on IDCNN-BLSA Feature Fusion

Aspect-Based Sentiment Analysis for User Reviews