Abstract:Automatic keyword extraction is an important research direction in text mining, natural language processing and information retrieval. Keyword extraction enables us to represent text documents in a condensed way. The compact representation of documents can be helpful in several applications, such as automatic indexing, automatic summarization, automatic classification, clustering and filtering. For instance, text classification is a domain with high dimensional feature space challenge. Hence, extracting the most important/relevant words about the content of the document and using these keywords as the features can be extremely useful. In this regard, this study examines the predictive performance of five statistical keyword extraction methods (most frequent measure based keyword extraction, term frequency-inverse sentence frequency based keyword extraction, co-occurrence statistical information based keyword extraction, eccentricity-based keyword extraction and TextRank algorithm) on classification algorithms and ensemble methods for scientific text document classification (categorization). In the study, a comprehensive study of comparing base learning algorithms (Naïve Bayes, support vector machines, logistic regression and Random Forest) with five widely utilized ensemble methods (AdaBoost, Bagging, Dagging, Random Subspace and Majority Voting) is conducted. To the best of our knowledge, this is the first empirical analysis, which evaluates the effectiveness of statistical keyword extraction methods in conjunction with ensemble learning algorithms. The classification schemes are compared in terms of classification accuracy, F-measure and area under curve values. To validate the empirical analysis, two-way ANOVA test is employed. The experimental analysis indicates that Bagging ensemble of Random Forest with the most-frequent based keyword extraction method yields promising results for text classification. For ACM document collection, the highest average predictive performance (93.80%) is obtained with the utilization of the most frequent based keyword extraction method with Bagging ensemble of Random Forest algorithm. In general, Bagging and Random Subspace ensembles of Random Forest yield promising results. The empirical analysis indicates that the utilization of keyword-based representation of text documents in conjunction with ensemble learning can enhance the predictive performance and scalability of text classification schemes, which is of practical importance in the application fields of text classification.

Academic Article Classification Algorithm Based on Pre-trained Model and Keyword Extraction

Database Systems for Advanced Applications

Academic News Text Classification Model Based on Attention Mechanism and RCNN

Improving short text classification using public search engines

Improving Short Text Classification Through Better Feature Space Selection

A Framework For Refining Text Classification and Object Recognition from Academic Articles

Enhancing Identification of Structure Function of Academic Articles Using Contextual Information

Research of Text Classification Based on TF-IDF and CNN-LSTM

Text Classification: A Perspective of Deep Learning Methods

News Text Classification Algorithm Based on Machine Learning Technology

Short Text Classification Model based on Pre-trained Language Model with Feature Fusion

Chinese Text Classification Model Based on Deep Learning

A Long-Text Classification Method of Chinese News Based on BERT and CNN

Ensemble of keyword extraction methods and classifiers in text classification

Using the full-text content of academic articles to identify and evaluate algorithm entities in the domain of natural language processing

A text classification network model combining machine learning and deep learning

Enhancing keyphrase extraction from academic articles with their reference information

News Text Classification Method and Simulation Based on the Hybrid Deep Learning Model

Long short-term memory (LSTM)-based news classification model