"Challenges and future in deep learning for sentiment analysis: a comprehensive review and a proposed novel hybrid approach"

Md. Shofiqul Islam,Muhammad Nomani Kabir,Ngahzaifa Ab Ghani,Kamal Zuhairi Zamli,Nor Saradatul Akmar Zulkifli,Md. Mustafizur Rahman,Mohammad Ali Moni

DOI: https://doi.org/10.1007/s10462-023-10651-9

IF: 9.588

2024-02-20

Artificial Intelligence Review

Abstract:Social media is used to categorise products or services, but analysing vast comments is time-consuming. Researchers use sentiment analysis via natural language processing, evaluating methods and results conventionally through literature reviews and assessments. However, our approach diverges by offering a thorough analytical perspective with critical analysis, research findings, identified gaps, limitations, challenges and future prospects specific to deep learning-based sentiment analysis in recent times. Furthermore, we provide in-depth investigation into sentiment analysis, categorizing prevalent data, pre-processing methods, text representations, learning models, and applications. We conduct a thorough evaluation of recent advances in deep learning architectures, assessing their pros and cons. Additionally, we offer a meticulous analysis of deep learning methodologies, integrating insights on applied tools, strengths, weaknesses, performance results, research gaps, and a detailed feature-based examination. Furthermore, we present in a thorough discussion of the challenges, drawbacks, and factors contributing to the successful enhancement of accuracy within the realm of sentiment analysis. A critical comparative analysis of our article clearly shows that capsule-based RNN approaches give the best results with an accuracy of 98.02% which is the CNN or RNN-based models. We implemented various advanced deep-learning models across four benchmarks to identify the top performers. Additionally, we introduced the innovative CRDC (Capsule with Deep CNN and Bi structured RNN) model, which demonstrated superior performance compared to other methods. Our proposed approach achieved remarkable accuracy across different databases: IMDB (88.15%), Toxic (98.28%), CrowdFlower (92.34%), and ER (95.48%). Hence, this method holds promise for automated sentiment analysis and potential deployment.

computer science, artificial intelligence

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper primarily addresses the following aspects:

1. **Current Status and Challenges of Sentiment Analysis**:
- Provides a comprehensive review of sentiment analysis methods based on deep learning and conducts a critical analysis, highlighting the shortcomings, limitations, and challenges of existing methods.
- Conducts an in-depth evaluation of recent advancements in deep learning for sentiment analysis, including the pros and cons of various models.

2. **Data Preprocessing and Representation**:
- Systematically discusses data preprocessing methods for sentiment analysis, text representation techniques, and performance evaluation metrics.

3. **Model Architectures and Algorithms**:
- Provides a detailed introduction to various deep learning models and their architectures, such as Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTM), etc., and compares their performance.

4. **Proposing Innovative Models**:
- Proposes a novel hybrid deep learning model CRDC (combining Capsule Networks, Bidirectional RNN, and Deep CNN) and demonstrates its superior performance in multiple benchmark tests.

5. **Applications and Future Directions**:
- Summarizes the applications of sentiment analysis in different fields, such as affective computing, text summarization, knowledge extraction, etc., and points out future research directions.

Through these efforts, the paper aims to provide a comprehensive and systematic review of deep learning-based sentiment analysis and offers a clear research direction for researchers.