Comprehensive Study on Sentiment Analysis: From Rule-based to modern LLM based system

Shailja Gupta,Rajesh Ranjan,Surya Narayan Singh
2024-09-16
Abstract:This paper provides a comprehensive survey of sentiment analysis within the context of artificial intelligence (AI) and large language models (LLMs). Sentiment analysis, a critical aspect of natural language processing (NLP), has evolved significantly from traditional rule-based methods to advanced deep learning techniques. This study examines the historical development of sentiment analysis, highlighting the transition from lexicon-based and pattern-based approaches to more sophisticated machine learning and deep learning models. Key challenges are discussed, including handling bilingual texts, detecting sarcasm, and addressing biases. The paper reviews state-of-the-art approaches, identifies emerging trends, and outlines future research directions to advance the field. By synthesizing current methodologies and exploring future opportunities, this survey aims to understand sentiment analysis in the AI and LLM context thoroughly.
Computation and Language,Artificial Intelligence,Computers and Society,Human-Computer Interaction
What problem does this paper attempt to address?
This paper aims to provide a comprehensive overview of the research progress in sentiment analysis within the context of Artificial Intelligence (AI) and Large Language Models (LLM). Specifically, the objectives of the paper include: 1. **Reviewing the development history of sentiment analysis techniques**: From traditional rule-based methods to modern deep learning models. 2. **Discussing key challenges and limitations**: Such as handling bilingual or multilingual texts, and recognizing sarcastic tones. 3. **Exploring the role of Large Language Models (LLM) in sentiment analysis**: How advanced LLMs can enhance the capabilities of sentiment analysis. 4. **Identifying emerging trends and proposing future research directions**: To address existing challenges and improve the effectiveness of sentiment analysis. By synthesizing current methodologies and exploring future opportunities, this review paper aims to achieve a comprehensive understanding of sentiment analysis in the context of AI and LLM.