Abstract:In recent years, the usage of ensemble learning in applications has grown significantly due to increasing computational power allowing the training of large ensembles in reasonable time frames. Many applications, e.g., malware detection, face recognition, or financial decision-making, use a finite set of learning algorithms and do aggregate them in a way that a better predictive performance is obtained than any other of the individual learning algorithms. In the field of Post-Silicon Validation for semiconductor devices (PSV), data sets are typically provided that consist of various devices like, e.g., chips of different manufacturing lines. In PSV, the task is to approximate the underlying function of the data with multiple learning algorithms, each trained on a device-specific subset, instead of improving the performance of arbitrary classifiers on the entire data set. Furthermore, the expectation is that an unknown number of subsets describe functions showing very different characteristics. Corresponding ensemble members, which are called outliers, can heavily influence the approximation. Our method aims to find a suitable approximation that is robust to outliers and represents the best or worst case in a way that will apply to as many types as possible. A 'soft-max' or 'soft-min' function is used in place of a maximum or minimum operator. A Neural Network (NN) is trained to learn this 'soft-function' in a two-stage process. First, we select a subset of ensemble members that is representative of the best or worst case. Second, we combine these members and define a weighting that uses the properties of the Local Outlier Factor (LOF) to increase the influence of non-outliers and to decrease outliers. The weighting ensures robustness to outliers and makes sure that approximations are suitable for most types.

Soft Rule Ensembles for Statistical Learning

Beyond Discriminant Patterns: On the Robustness of Decision Rule Ensembles

Learning Locally Interpretable Rule Ensemble

Learning Classifier System Ensemble and Compact Rule Set

Hybrid Ensemble Learning Approach for Generation of Classification Rules

Joint Sparse Learning for Classification Ensemble.

Ensemble independent component regression models and soft sensing application

Rule Covering for Interpretation and Boosting

Multi-Aspect Diversification of Samples and Features for Advanced Creation of Rule Ensemble

Selective Ensemble under Regularization Framework

Better Short than Greedy: Interpretable Models through Optimal Rule Boosting

Ensemble learning classifier system and compact ruleset

ORSA: Outlier Robust Stacked Aggregation for Best- and Worst-Case Approximations of Ensemble Systems\

Heuristic Creation of Deep Rule Ensemble Through Iterative Expansion of Feature Space

Refine Decision Boundaries of a Statistical Ensemble by Active Learning

Rule Learning Based on Neural Network Ensemble

Improved prediction rule ensembling through model-based data generation

Sampling ensembles for frequent patterns

Ensembling over Classifiers: a Bias-Variance Perspective

EnsLoss: Stochastic Calibrated Loss Ensembles for Preventing Overfitting in Classification

A Bias-Variance Decomposition for Ensembles over Multiple Synthetic Datasets