A BERT-based multi-semantic learning model with aspect-aware enhancement for aspect polarity classification
Xinhua Zhu,Yuxiang Zhu,Lanfang Zhang,Yishan Chen
DOI: https://doi.org/10.1007/s10489-022-03702-1
IF: 5.3
2022-06-14
Applied Intelligence
Abstract:Aspect-Based Sentiment Classification (ABSA), predicting the sentimental tendency towards given aspects, is an important branch in natural language understanding. However, in the existing deep learning models for ABSA, there is a contradiction between the fine sentiment analysis and the small amount of corpus. To solve this contradiction, we propose a BERT-based Multi-Semantic Learning (BERT-MSL) model with aspect-aware enhancement for aspect polarity classification, which follows the Transformer structure in BERT and uses lightweight multi-head self-attentions for encoding. First, we make full use of the extensive pre-training and post-training of the BERT model to obtain the initialization parameters with rich knowledge for our BERT-MSL model, so that our model can be quickly adapted to the ABSA task only by fine-tuning on a small corpus. Second, to achieve the fine sentiment analysis centered on aspect target, we propose a BERT-based multi-semantic learning model composed of the left-side local semantic, right-side local semantic, aspect target semantic and global semantic learning modules, and propose an aspect-aware enhancement method based on BERT and multi-head attention. Third, we propose two alternative semantic merging methods to generate the final expressive-powerful sentiment semantics for ABSA. Furthermore, to expand the application scope of our model, we design an advanced structure for our model by introducing a CNN-based semantic refinement layer. Experimental results on five SemEval and Twitter datasets demonstrate that our model improves the stability and robustness of ABSA and significantly outperforms some of the state-of-the-art models under the BERT Post-Training (BERT-PT) environment.
computer science, artificial intelligence