A BERT Fine-tuning Model for Targeted Sentiment Analysis of Chinese Online Course Reviews

Huibing Zhang,Junchao Dong,Liang Min,Peng Bi
DOI: https://doi.org/10.1142/s0218213020400187
IF: 1.1
2020-11-30
International Journal on Artificial Intelligence Tools
Abstract:Accurate analysis of targeted sentiment in online course reviews helps in understanding emotional changes of learners and improving the course quality. In this paper, we propose a fine-tuned bidirectional encoder representation from transformers (BERT) model for targeted sentiment analysis of course reviews. Specifically, it consists of two parts: binding corporate rules — conditional random field (BCR-CRF) target extraction model and a binding corporate rules — double attention (BCR-DA) target sentiment analysis model. Firstly, based on a large-scale Chinese review corpus, intra-domain unsupervised training of a BERT pre-trained model (BCR) is performed. Then, a Conditional Random Field (CRF) layer is introduced to add grammatical constraints to the output sequence of the semantic representation layer in the BCR model. Finally, a BCR-DA model containing double attention layers is constructed to express the sentiment polarity of the course review targets in a classified manner. Experiments are performed on Chinese online course review datasets of China MOOC. The experimental results show that the F1 score of the BCR-CRF model reaches above 92%, and the accuracy of the BCR-DA model reaches above 72%.
computer science, artificial intelligence, interdisciplinary applications
What problem does this paper attempt to address?