Abstract:Regression uses supervised machine learning to find a model that combines several independent variables to predict a dependent variable based on ground truth (labeled) data, i.e., tuples of independent and dependent variables (labels). Similarly, aggregation also combines several independent variables to a dependent variable. The dependent variable should preserve properties of the independent variables, e.g., the ranking or relative distance of the independent variable tuples, and/or represent a latent ground truth that is a function of these independent variables. However, ground truth data is not available for finding the aggregation model. Consequently, aggregation models are data agnostic or can only be derived with unsupervised machine learning approaches. We introduce a novel unsupervised aggregation approach based on intrinsic properties of unlabeled training data, such as the cumulative probability distributions of the single independent variables and their mutual dependencies. We present an empirical evaluation framework that allows assessing the proposed approach against other aggregation approaches from two perspectives: (i) how well the aggregation output represents properties of the input tuples, and (ii) how well can aggregated output predict a latent ground truth. To this end, we use data sets for assessing supervised regression approaches that contain explicit ground truth labels. However, the ground truth is not used for deriving the aggregation models, but it allows for the assessment from a perspective (ii). More specifically, we use regression data sets from the UCI machine learning repository and benchmark several data-agnostic and unsupervised approaches for aggregation against ours. The benchmark results indicate that our approach outperforms the other data-agnostic and unsupervised aggregation approaches. It is almost on par with linear regression.

A subspace aggregating algorithm for accurate classification

Subspace Ensembles for Classification

A New Classification Algorithm Research

A Non-Parametric Subspace Analysis Approach with Application to Anomaly Detection Ensembles

A Subspace Ensemble Framework for Classification with High Dimensional Missing Data

A Weighted Subspace Approach for Improving Bagging Performance

Efficient Direct Structured Subspace Clustering

Subspace Embedding for Classification

An agglomerative fuzzy k-means approach to building decision cluster classifiers

Inductive Latent Space Sparse and Low-rank Subspace Clustering Algorithm

A naive aggregation algorithm for improving generalization in a class of learning problems

Sequential Three-Way Classifier with Justifiable Granularity

Nonparametric Bayes Classification via Learning of Affine Subspaces

Discovering Hidden Knowledge in Data Classification Via Multivariate Analysis

Multi-resolution subsampling for large-scale linear classification

Self-tuned Visual Subclass Learning with Shared Samples An Incremental Approach

A Novel Genetic Algorithm for Subspace Based Subclasssifier Selection

Aggregation as Unsupervised Learning and its Evaluation

Learnable Subspace Clustering

Subspace learning machine (SLM): Methodology and performance evaluation

Training Boosting-Like Algorithms with Semi-Supervised Subspace Learning