Abstract:Automatic keyword extraction is an important research direction in text mining, natural language processing and information retrieval. Keyword extraction enables us to represent text documents in a condensed way. The compact representation of documents can be helpful in several applications, such as automatic indexing, automatic summarization, automatic classification, clustering and filtering. For instance, text classification is a domain with high dimensional feature space challenge. Hence, extracting the most important/relevant words about the content of the document and using these keywords as the features can be extremely useful. In this regard, this study examines the predictive performance of five statistical keyword extraction methods (most frequent measure based keyword extraction, term frequency-inverse sentence frequency based keyword extraction, co-occurrence statistical information based keyword extraction, eccentricity-based keyword extraction and TextRank algorithm) on classification algorithms and ensemble methods for scientific text document classification (categorization). In the study, a comprehensive study of comparing base learning algorithms (Naïve Bayes, support vector machines, logistic regression and Random Forest) with five widely utilized ensemble methods (AdaBoost, Bagging, Dagging, Random Subspace and Majority Voting) is conducted. To the best of our knowledge, this is the first empirical analysis, which evaluates the effectiveness of statistical keyword extraction methods in conjunction with ensemble learning algorithms. The classification schemes are compared in terms of classification accuracy, F-measure and area under curve values. To validate the empirical analysis, two-way ANOVA test is employed. The experimental analysis indicates that Bagging ensemble of Random Forest with the most-frequent based keyword extraction method yields promising results for text classification. For ACM document collection, the highest average predictive performance (93.80%) is obtained with the utilization of the most frequent based keyword extraction method with Bagging ensemble of Random Forest algorithm. In general, Bagging and Random Subspace ensembles of Random Forest yield promising results. The empirical analysis indicates that the utilization of keyword-based representation of text documents in conjunction with ensemble learning can enhance the predictive performance and scalability of text classification schemes, which is of practical importance in the application fields of text classification.

Keyword extraction using Renyi entropy: a statistical and domain independent method

Keyword Extraction Approach Based on Probabilistic-Entropy, Graph, and Neural Network Methods

Empirical Analysis on a Keyword-Based Semantic System

Robust and Fast Measure of Information Via Low-Rank Representation

An efficient domain-independent approach for supervised keyphrase extraction and ranking

Keywords Extraction Based on Word Relevance Degrees

Theme-weighted Ranking of Keywords from Text Documents using Phrase Embeddings

Ensemble of keyword extraction methods and classifiers in text classification

Impact analysis of keyword extraction using contextual word embedding

Graph-based Semantical Extractive Text Analysis

Single Document Keyword Extraction for Internet News Articles

MICRank: Multi-information interconstrained keyphrase extraction

News-Oriented Keyword Indexing with Maximum Entropy Principle.

Extracting Keyphrases Using Heterogeneous Word Relations.

Research on Maximum Entropy Model for Keyword Indexing

Deep-KeywordNet: automated english keyword extraction in documents using deep keyword network based ranking

EntropyRank: Unsupervised Keyphrase Extraction via Side-Information Optimization for Language Model-based Text Compression

Cross-Domain Keyword Extraction with Keyness Patterns

Keyword Extraction: A Modern Perspective

Document-specific Keyphrase Candidate Search and Ranking