Abstract:Background: The proliferation of digital commerce has allowed merchants to reach out to a wider customer base, prompting a study of customer reviews to gauge service and product quality through sentiment analysis. Sentiment analysis can be enhanced through subjectivity and objectivity classification with attention mechanisms. Methods: This research includes input corpora of contrasting levels of subjectivity and objectivity from different databases to perform sentiment analysis on user reviews, incorporating attention mechanisms at the aspect level. Three large corpora are chosen as the subjectivity and objectivity datasets, the Shopee user review dataset (ShopeeRD) for subjectivity, together with the Wikipedia English dataset (Wiki-en) and Internet Movie Database (IMDb) for objectivity. Word embeddings are created using Word2Vec with Skip-Gram. Then, a bidirectional LSTM with an attention layer (LSTM-ATT) imposed on word vectors. The performance of the model is evaluated and benchmarked against classification models of Logistics Regression (LR) and Linear SVC (L-SVC). Three models are trained with subjectivity (70% of ShopeeRD) and the objectivity (Wiki-en) embeddings, with ten-fold cross-validation. Next, the three models are evaluated against two datasets (IMDb and 20% of ShopeeRD). The experiments are based on benchmark comparisons, embedding comparison and model comparison with 70-10-20 train-validation-test splits. Data augmentation using AUG-BERT is performed and selected models incorporating AUG-BERT, are compared. Results: L-SVC scored the highest accuracy with 56.9% for objective embeddings (Wiki-en) while the LSTM-ATT scored 69.0% on subjective embeddings (ShopeeRD). Improved performances were observed with data augmentation using AUG-BERT, where the LSTM-ATT+AUG-BERT model scored the highest accuracy at 60.0% for objective embeddings and 70.0% for subjective embeddings, compared to 57% (objective) and 69% (subjective) for L-SVC+AUG-BERT, and 56% (objective) and 68% (subjective) for L-SVC. Conclusions: Utilizing attention layers with subjectivity and objectivity notions has shown improvement to the accuracy of sentiment analysis models.

Combining a large sentiment lexicon and machine learning for subjectivity classification

A Mixture Language Model for the Classification of Chinese Online Reviews.

Twitter Sentiment Analysis: Lexicon Method, Machine Learning Method and Their Combination

Sentiment Lexicon Enhanced Neural Sentiment Classification

Sentiment Classification Using Subjective and Objective Views

Sentiment Classification in Chinese Microblogs: Lexicon-based and Learning-based Approaches

Joint Bilingual Sentiment Classification with Unlabeled Parallel Corpora.

Sentiment Analysis With Automatically Constructed Lexicon And Three-Way Decision

A lexicon-based approach for sentiment analysis of multimodal content in tweets

Practical Text Classification With Large Pre-Trained Language Models

Modelling sentiments based on objectivity and subjectivity with self-attention mechanisms

User reviews: Sentiment analysis using lexicon integrated two-channel CNN–LSTM family models

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

Sentiment Lexicon Enhanced Attention-Based LSTM for Sentiment Classification

Do Large Language Models Possess Sensitive to Sentiment?

Combining User-Based and Global Lexicon Features for Sentiment Analysis in Twitter

Lex2Sent: A bagging approach to unsupervised sentiment analysis

More than a Feeling: Accuracy and Application of Sentiment Analysis

Generative Sentiment Classification Model Affiliating Domain-Specific Sentiment Lexicons

Domain-Specific Sentiment Classification Via Fusing Sentiment Knowledge from Multiple Sources

Sentiment Classification Using Supervised and Semi-Supervised Conditional Maximum Entropy Modeling.