Abstract:Background: The proliferation of digital commerce has allowed merchants to reach out to a wider customer base, prompting a study of customer reviews to gauge service and product quality through sentiment analysis. Sentiment analysis can be enhanced through subjectivity and objectivity classification with attention mechanisms. Methods: This research includes input corpora of contrasting levels of subjectivity and objectivity from different databases to perform sentiment analysis on user reviews, incorporating attention mechanisms at the aspect level. Three large corpora are chosen as the subjectivity and objectivity datasets, the Shopee user review dataset (ShopeeRD) for subjectivity, together with the Wikipedia English dataset (Wiki-en) and Internet Movie Database (IMDb) for objectivity. Word embeddings are created using Word2Vec with Skip-Gram. Then, a bidirectional LSTM with an attention layer (LSTM-ATT) imposed on word vectors. The performance of the model is evaluated and benchmarked against classification models of Logistics Regression (LR) and Linear SVC (L-SVC). Three models are trained with subjectivity (70% of ShopeeRD) and the objectivity (Wiki-en) embeddings, with ten-fold cross-validation. Next, the three models are evaluated against two datasets (IMDb and 20% of ShopeeRD). The experiments are based on benchmark comparisons, embedding comparison and model comparison with 70-10-20 train-validation-test splits. Data augmentation using AUG-BERT is performed and selected models incorporating AUG-BERT, are compared. Results: L-SVC scored the highest accuracy with 56.9% for objective embeddings (Wiki-en) while the LSTM-ATT scored 69.0% on subjective embeddings (ShopeeRD). Improved performances were observed with data augmentation using AUG-BERT, where the LSTM-ATT+AUG-BERT model scored the highest accuracy at 60.0% for objective embeddings and 70.0% for subjective embeddings, compared to 57% (objective) and 69% (subjective) for L-SVC+AUG-BERT, and 56% (objective) and 68% (subjective) for L-SVC. Conclusions: Utilizing attention layers with subjectivity and objectivity notions has shown improvement to the accuracy of sentiment analysis models.

An Efficient Model for Sentiment Analysis of Electronic Product Reviews in Vietnamese

Sentiment Classification for Chinese Reviews: a Comparison Between SVM and Semantic Approaches

Sentiment Analysis of Customer Feedback in Online Food Ordering Services

Analysis of online user sentiment and behavior in the tourism sector in Vietnam based on reviews and comments

An attention-based deep learning method for text sentiment analysis

Developing an Intelligent System with Deep Learning Algorithms for Sentiment Analysis of E-Commerce Product Reviews

Word Vector Modeling for Sentiment Analysis of Product Reviews

Unveiling Comparative Sentiments in Vietnamese Product Reviews: A Sequential Classification Framework

Real-time Sentiment Analysis on E-Commerce Application

Vietnamese Sentiment Analysis: An Overview and Comparative Study of Fine-tuning Pretrained Language Models

Efficient Long Short-Term Memory-Based Sentiment Analysis of E-Commerce Reviews

Vietnamese Complaint Detection on E-Commerce Websites

Deep Learning versus Traditional Classifiers on Vietnamese Students' Feedback Corpus

A HYBRID DEEP LEARNING APPROACH FOR SENTIMENT ANALYSIS IN PRODUCT REVIEWS

Effective Vietnamese Sentiment Analysis Model Using Sentiment Word Embedding and Transfer Learning

Metadata Integration for Spam Reviews Detection on Vietnamese E-commerce Websites

Modelling sentiments based on objectivity and subjectivity with self-attention mechanisms

Sentiment Analysis for E-Commerce Product Reviews in Chinese Based on Sentiment Lexicon and Deep Learning

Emotion Recognition for Vietnamese Social Media Text

Enhancing Comparative Opinion Mining in Vietnamese Product Reviews: A Hybrid Generative Model Approach with Knowledge Base Integration

Sentiment Classification for Chinese Product Reviews Based on Semantic Relevance of Phrase.