Abstract:Over the past few decades, text classification problems have been widely utilized in many real time applications. Leveraging the text classification methods by means of developing new applications in the field of text mining and Natural Language Processing (NLP) is very important. In order to accurately classify tasks in many applications, a deeper insight into deep learning methods is required as there is an exponential growth in the number of complex documents. The success of any deep learning algorithm depends on its capacity to understand the nonlinear relationships of the complex models within data. Thus, a huge challenge for researchers lies in the development of suitable techniques, architectures, and models for text classification. In this paper, hybrid deep learning models, with an emphasis on positioning of attention mechanism analysis, are considered and analyzed well for text classification. The first hybrid model proposed is called convolutional Bidirectional Long Short-Term Memory (Bi-LSTM) with attention mechanism and output (CBAO) model, and the second hybrid model is called convolutional attention mechanism with Bi-LSTM and output (CABO) model. In the first hybrid model, the attention mechanism is placed after the Bi-LSTM, and then the output Softmax layer is constructed. In the second hybrid model, the attention mechanism is placed after convolutional layer and followed by Bi-LSTM and the output Softmax layer. The proposed hybrid models are tested on three datasets, and the results show that when the proposed CBAO model is implemented for IMDB dataset, a high classification accuracy of 92.72% is obtained and when the proposed CABO model is implemented on the same dataset, a high classification accuracy of 90.51% is obtained.

Zebra: A Novel Method for Optimizing Text Classification Query in Overload Scenario

Database Systems for Advanced Applications

Improving short text classification using public search engines

A Technique For Improving The Performance Of Naive Bayes Text Classification

Improving Short Text Classification Through Better Feature Space Selection

Processing Long Queries Against Short Text

Optimizing News Text Classification with Bi-LSTM and Attention Mechanism for Efficient Data Processing

Context‐aware text classification system to improve the quality of text: A detailed investigation and techniques

A High Performance Two-Class Chinese Text Categorization Method

Text Guide: Improving the quality of long text classification by a text selection method based on feature importance

Research on performance variations of classifiers with the influence of pre-processing methods for Chinese short text classification

Towards Text-to-SQL over Aggregate Tables

Research on the Application of Improved BERT‐DPCNN Model in Chinese News Text Classification

Parrot: A Progressive Analysis System on Large Text Collections

Efficient Text Classification Using Term Projection

Finding decision jumps in text classification

A multi-semantic passing framework for semi-supervised long text classification

Performance Analysis of Hybrid Deep Learning Models with Attention Mechanism Positioning and Focal Loss for Text Classification

What Have Been Learned & What Should Be Learned? An Empirical Study of How to Selectively Augment Text for Classification

Key Information Retrieval to Classify the Unstructured Data Content of Preferential Trade Agreements

Retrieval Augmented Zero-Shot Text Classification