Abstract:Multi-label text classification (MLTC) is a popular method for organizing electronic documents, which is crucial for accessing and processing data. As the number of classes increases, learning multi-label data will be challenging. The number of possible states for various labels increases exponentially, and learning algorithms in single-label data cannot be used to solve these problems. In the meantime, using single-label data algorithms could be very time-consuming. In MLTC, complexity costs should be reduced. Deep-learning neural networks that can learn intricate patterns are used in many real-world problems because of their high power and accuracy. This paper proposed a hybridization of the long short-term memory (LSTM) neural network and the convolutional neural network (CNN) method for MLTC. The proposed model uses LSTM to enhance CNN to improve the proposed model's accuracy. Also, the competitive search algorithm (CSA) is used to improve the LSTM hyperparameters. The LSTM hyperparameters play an important role in increasing the detection accuracy. The CSA algorithm finds the best values for the hyperparameters by searching the problem space. It was tested on four different datasets of multi-label texts: Reuters-21578, RCV1-v2, EUR-Lex, and Bookmarks. The result showed that the proposed model performed better than CNN and LSTM-CSA in terms of accuracy percentage and that it has improved by an average of more than 10%. Also, the results show that the LSTM-CSA model has higher detection accuracy compared to LSTM—Gradient-based optimizer (GBO) and LSTM—whale optimization algorithm (WOA).

Convolutional Long Short-term Memory for Long Length Document Classification

Database Systems for Advanced Applications

Long Document Classification From Local Word Glimpses via Recurrent Attention Learning.

A text classification method based on a convolutional and bidirectional long short-term memory model

Hierarchical Multi-granularity Interaction Graph Convolutional Network for Long Document Classification

Local Bidirectional Long Short Term Memory for Text Classification

A Multi-feature Fusion Method with Attention Mechanism for Long Text Classification

Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification.

Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents

A Long-Text Classification Method of Chinese News Based on BERT and CNN

Hierarchical Recurrent and Convolutional Neural Network Based on Attention for Chinese Document Classification

Automatically Classifying Chinese Judgment Documents Using Character-Level Convolutional Neural Networks

A Hybrid Model Based on Convolutional Neural Network and Long Short-Term Memory for Multi-label Text Classification

Text Classification Method Based On Convolution Neural Network

Convolutional Neural Networks for Text Classification with Multi-size Convolution and Multi-type Pooling.

Research of Text Classification Based on TF-IDF and CNN-LSTM

Attention-based BiLSTM fused CNN with gating mechanism model for Chinese long text classification

Deep Learning for Technical Document Classification

Chinese Text Classification Model Based on Deep Learning