Abstract:Background Most machine-learning classifiers output label predictions for new instances without indicating how reliable the predictions are. The applicability of these classifiers is limited in critical domains where incorrect predictions have serious consequences, like medical diagnosis. Further, the default assumption of equal misclassification costs is most likely violated in medical diagnosis. Results In this paper, we present a modified random forest classifier which is incorporated into the conformal predictor scheme. A conformal predictor is a transductive learning scheme, using Kolmogorov complexity to test the randomness of a particular sample with respect to the training sets. Our method show well-calibrated property that the performance can be set prior to classification and the accurate rate is exactly equal to the predefined confidence level. Further, to address the cost sensitive problem, we extend our method to a label-conditional predictor which takes into account different costs for misclassifications in different class and allows different confidence level to be specified for each class. Intensive experiments on benchmark datasets and real world applications show the resultant classifier is well-calibrated and able to control the specific risk of different class. Conclusion The method of using RF outlier measure to design a nonconformity measure benefits the resultant predictor. Further, a label-conditional classifier is developed and turn to be an alternative approach to the cost sensitive learning problem that relies on label-wise predefined confidence level. The target of minimizing the risk of misclassification is achieved by specifying the different confidence level for different class.

Random Bits Forest: a Strong Classifier/Regressor for Big Data

Random Bits Regression: a Strong General Predictor for Big Data

Random Forests for Big Data

Random Forest for Bioinformatics

Using random forest for reliable classification and cost-sensitive learning for medical diagnosis

A New Rotation Forest Ensemble Algorithm

A Dynamic Boosted Ensemble Learning Method Based on Random Forest

Random Survival Forests Incorporated by the Nadaraya-Watson Regression

Deep Dynamic Boosted Forest.

Search for the Smallest Random Forest

ggRandomForests: Exploring Random Forest Survival

Random Forest (RF) Kernel for Regression, Classification and Survival

Banzhaf Random Forests

Neural Forest Learning.

Common, uncommon, and novel applications of random forest in psychological research

Head Pose Estimation Based on Random Forests for Multiclass Classification

Towards the effectiveness of Deep Convolutional Neural Network based Fast Random Forest Classifier

Riemann-Lebesgue Forest for Regression

Random Forests: some methodological insights

New machine learning algorithm: random forest

When are Deep Networks really better than Decision Forests at small sample sizes, and how?