Abstract:Automatic keyword extraction is an important research direction in text mining, natural language processing and information retrieval. Keyword extraction enables us to represent text documents in a condensed way. The compact representation of documents can be helpful in several applications, such as automatic indexing, automatic summarization, automatic classification, clustering and filtering. For instance, text classification is a domain with high dimensional feature space challenge. Hence, extracting the most important/relevant words about the content of the document and using these keywords as the features can be extremely useful. In this regard, this study examines the predictive performance of five statistical keyword extraction methods (most frequent measure based keyword extraction, term frequency-inverse sentence frequency based keyword extraction, co-occurrence statistical information based keyword extraction, eccentricity-based keyword extraction and TextRank algorithm) on classification algorithms and ensemble methods for scientific text document classification (categorization). In the study, a comprehensive study of comparing base learning algorithms (Naïve Bayes, support vector machines, logistic regression and Random Forest) with five widely utilized ensemble methods (AdaBoost, Bagging, Dagging, Random Subspace and Majority Voting) is conducted. To the best of our knowledge, this is the first empirical analysis, which evaluates the effectiveness of statistical keyword extraction methods in conjunction with ensemble learning algorithms. The classification schemes are compared in terms of classification accuracy, F-measure and area under curve values. To validate the empirical analysis, two-way ANOVA test is employed. The experimental analysis indicates that Bagging ensemble of Random Forest with the most-frequent based keyword extraction method yields promising results for text classification. For ACM document collection, the highest average predictive performance (93.80%) is obtained with the utilization of the most frequent based keyword extraction method with Bagging ensemble of Random Forest algorithm. In general, Bagging and Random Subspace ensembles of Random Forest yield promising results. The empirical analysis indicates that the utilization of keyword-based representation of text documents in conjunction with ensemble learning can enhance the predictive performance and scalability of text classification schemes, which is of practical importance in the application fields of text classification.

Comparative analysis of ensemble learning methods for signal classification

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

An Experimental Evaluation of Ensemble Methods for EEG Signal Classification

Comparison of Bagging and Boosting Ensemble Machine Learning Methods for Automated EMG Signal Classification

Ensemble Fusion Models Using Various Strategies and Machine Learning for EEG Classification

Sentiment classification: The contribution of ensemble learning

Ensemble of keyword extraction methods and classifiers in text classification

A Comparative Study of Ensemble Learning Approaches in the Classification of Breast Cancer Metastasis

Bagged Voting Ensembles

Voting Combinations-Based Ensemble: A Hybrid Approach

The relative performance of ensemble methods with deep convolutional neural networks for image classification

Performance assessment of ensemble learning systems in financial data classification

Toward Improving Breast Cancer Classification Using an Adaptive Voting Ensemble Learning Algorithm

Ensemble of feature sets and classification algorithms for sentiment classification

A practical tutorial on bagging and boosting based ensembles for machine learning: Algorithms, software tools, performance study, practical perspectives and opportunities

Comparison of Ensemble Models as Solutions for Imbalanced Class Classification of Datasets

Sound Classification Using Evolving Ensemble Models and Particle Swarm Optimization.

Empirical Evaluation of Ensemble Learning for Credit Scoring

A COMPARATIVE ANALYSIS OF ENSEMBLE LEARNING METHODS ON SOCIAL MEDIA ACCOUNT DETECTION

An automated ensemble approach using Harris Hawk optimization for visually evoked EEG signal classification

Comparative analysis of weka-based classification algorithms on medical diagnosis datasets