Abstract:In machine learning (ML), ensemble methods such as bagging, boosting, and stacking are widely-established approaches that regularly achieve top-notch predictive performance. Stacking (also called "stacked generalization") is an ensemble method that combines heterogeneous base models, arranged in at least one layer, and then employs another metamodel to summarize the predictions of those models. Although it may be a highly-effective approach for increasing the predictive performance of ML, generating a stack of models from scratch can be a cumbersome trial-and-error process. This challenge stems from the enormous space of available solutions, with different sets of data instances and features that could be used for training, several algorithms to choose from, and instantiations of these algorithms using diverse parameters (i.e., models) that perform differently according to various metrics. In this work, we present a knowledge generation model, which supports ensemble learning with the use of visualization, and a visual analytics system for stacked generalization. Our system, StackGenVis, assists users in dynamically adapting performance metrics, managing data instances, selecting the most important features for a given data set, choosing a set of top-performant and diverse algorithms, and measuring the predictive performance. In consequence, our proposed tool helps users to decide between distinct models and to reduce the complexity of the resulting stack by removing overpromising and underperforming models. The applicability and effectiveness of StackGenVis are demonstrated with two use cases: a real-world healthcare data set and a collection of data related to sentiment/stance detection in texts. Finally, the tool has been evaluated through interviews with three ML experts.

Reranking For Stacking Ensemble Learning

Classifier Ensemble by Exploring Supplementary Ordering Information

Enhancing binary classification: A new stacking method via leveraging computational geometry

Systematic Ensemble Learning for Regression

A Clustering Resampling Stacked Ensemble Method for Imbalance Classification Problem

Personal Credit Risk Assessment Based on Stacking Ensemble Model

Study of Ensemble Algorithm and Its Application

Exploration of the Stacking Ensemble Machine Learning Algorithm for Cheating Detection in Large-Scale Assessment

MEOD: A Robust Multi-stage Ensemble Model Based on Rank Aggregation and Stacking for Outlier Detection.

StackGenVis: Alignment of Data, Algorithms, and Models for Stacking Ensemble Learning Using Performance Metrics

A Novel Heterogeneous Ensemble Credit Scoring Model Based on Bstacking Approach

Stacking Learning with Coalesced Cost Filtering for Accurate Stereo Matching

Feature-Weighted Linear Stacking

Stacking Ensemble Technique for Classifying Breast Cancer

A Novel Classification Method Based on Stacking Ensemble for Imbalanced Problems.

Effective training-time stacking for ensembling of deep neural networks

InterpretStack: Interpretable Exploration and Interactive Visualization Construction of Stacking Algorithm

An Improved Stacking Framework for Stock Index Prediction by Leveraging Tree-Based Ensemble Models and Deep Learning Algorithms

Learning to Rank with Ensemble Ranking SVM

A Generalized Stacking for Implementing Ensembles of Gradient Boosting Machines

Multi-classification assessment of personal credit risk based on stacking integration