Abstract:No matter whether they are univariate or multivariate decision forests, most of previous decision forests determine their partition hyperplanes at split nodes by exhaustive search from candidates or by random generation, which makes some dent in either efficiency or accuracy. In this paper, we propose a new oblique/multivariate decision forest, a forest of trees with principal direction specified oblique split on random subspace (FPDS), where each split of trees is uniquely deterministic once the random feature subspace is determined, the largest principal direction of Principal Component Analysis (PCA) on the sample data at the corresponding split node and the median value of all the current sample points’ projections on the largest principal direction directly specified as the normal direction and the cut-point of the partition hyperplane. This method avoids either tediously searching for the optimal split or casually randomly generating the split. The heuristic method to obtain the hyperplanes guarantees accuracy of trees, and the random feature subspace selection adequately ensures the diversity among individual trees in the forest. In addition, each tree of the FPDS uses the whole training set instead of the sampling subset. Therefore, the only randomness factor in the FPDS derives from the random feature subspace selection, which to some extent enhances the robustness. It proves that the proposed forest FPDS is an alternative classifier which can match or even outperform the existing ensemble classifiers or other classifiers.

Construct Rough Decision Forests Based on Sequentially Data Reduction

Constructing rough decision forests

2 Three Techniques to Construct Rough Decision Forests

Construction Method of Decision Forests Based on Rough Set Reduction

Rough set based decision tree

The random subspace method for constructing decision forests

An Ensemble Framework to Forest Optimization Based Reduct Searching

Improvement on Classification Performance Based on Multiple Reduct Ensemble

A Forest of Trees with Principal Direction Specified Oblique Split on Random Subspace.

A Novel Approach of Multiple Submodel Integration Based on Decision Forest Construction

An Optimized Algorithm of Decision Tree Based on Rough Sets Model

Random Subsequence Forests

A New Rotation Forest Ensemble Algorithm

Δ-Cut Decision-Theoretic Rough Set Approach: Model and Attribute Reductions.

A New Random Forest Ensemble of Intuitionistic Fuzzy Decision Trees

Decision Forest: Combining the Predictions of Multiple Independent Decision Tree Models

Efficient random subspace decision forests with a simple probability dimensionality setting scheme

Analysis On Classification Performance Of Rough Set Based Reducts

Towards generating random forests via extremely randomized trees

An Efficient Method for Computing All Reducts

MTForest: Ensemble Decision Trees based on Multi-Task Learning