Abstract:Aspect-based Sentiment Analysis (ABSA) is a critical task in Natural Language Processing (NLP) that focuses on extracting sentiments related to specific aspects within a text, offering deep insights into customer opinions. Traditional sentiment analysis methods, while useful for determining overall sentiment, often miss the implicit opinions about particular product or service features. This paper presents a comprehensive review of the evolution of ABSA methodologies, from lexicon-based approaches to machine learning and deep learning techniques. We emphasize the recent advancements in Transformer-based models, particularly Bidirectional Encoder Representations from Transformers (BERT) and its variants, which have set new benchmarks in ABSA tasks. We focused on finetuning Llama and Mistral models, building hybrid models using the SetFit framework, and developing our own model by exploiting the strengths of state-of-the-art (SOTA) Transformer-based models for aspect term extraction (ATE) and aspect sentiment classification (ASC). Our hybrid model Instruct - DeBERTa uses SOTA InstructABSA for aspect extraction and DeBERTa-V3-baseabsa-V1 for aspect sentiment classification. We utilize datasets from different domains to evaluate our model's performance. Our experiments indicate that the proposed hybrid model significantly improves the accuracy and reliability of sentiment analysis across all experimented domains. As per our findings, our hybrid model Instruct - DeBERTa is the best-performing model for the joint task of ATE and ASC for both SemEval restaurant 2014 and SemEval laptop 2014 datasets separately. By addressing the limitations of existing methodologies, our approach provides a robust solution for understanding detailed consumer feedback, thus offering valuable insights for businesses aiming to enhance customer satisfaction and product development.

Enhancing Natural Language Processing with LDA-BERT Integration: A Comprehensive Review of Methodologies, Applications, and Future Directions

BERT: A Review of Applications in Natural Language Processing and Understanding

An integrated clustering and BERT framework for improved topic modeling

A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processing

Advancements and Methodologies in Natural Language Processing and Machine Learning: A Comprehensive Review

Performance and sustainability of BERT derivatives in dyadic data

Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies

Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa

BERT: A Review of Applications in Sentiment Analysis

Evolution and advancements in deep learning models for Natural Language Processing

Application of Deep Learning-Based Natural Language Processing in Multilingual Sentiment Analysis

Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges

Instruct-DeBERTa: A Hybrid Approach for Aspect-based Sentiment Analysis on Textual Reviews

An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysis

TopicBERT: A Topic-Enhanced Neural Language Model Fine-Tuned for Sentiment Classification

Natural language processing with transformers: a review

Advancements in deep learning and natural language processing for effective disaster sentiment analysis: A review

Exploiting BERT for End-to-End Aspect-based Sentiment Analysis

A Hybrid Approach to Dimensional Aspect-Based Sentiment Analysis Using BERT and Large Language Models

Aspect-Level Sentiment Analysis Approach via BERT and Aspect Feature Location Model