Abstract:The wealth of knowledge imbedded in gene expression data from DNA microarrays portends rapid advances in both research and clinic. Turning the prodigious and noisy data into knowledge is a challenge to the field of bioinformatics, and development of classifiers using supervised learning techniques is the primary methodological approach for clinical application using gene expression data. In this paper, we present a novel classification method, multiclass Decision Forest (DF), that is the direct extension of the two-class DF previously developed in our lab. Central to DF is the synergistic combining of multiple heterogenic but comparable decision trees to reach a more accurate and robust classification model. The computationally inexpensive multiclass DF algorithm integrates gene selection and model development, and thus eliminates the bias of gene preselection in crossvalidation. Importantly, the method provides several statistical means for assessment of prediction accuracy, prediction confidence, and diagnostic capability. We demonstrate the method by application to gene expression data for 83 small round blue-cell tumors (SRBCTs) samples belonging to one of four different classes. Based on 500 runs of 10-fold crossvalidation, tumor prediction accuracy was -97%, sensitivity was -95%, diagnostic sensitivity was -91%, and diagnostic accuracy was -99.5%. Among 25 genes selected to distinguish tumor class, 12 have functional information in the literature implicating their involvement in cancer. The four types of SRBCTs samples are also distinguishable in a clustering analysis based on the expression profiles of these 25 genes. The results demonstrated that the multiclass DF is an effective classification method for analysis of gene expression data for the purpose of molecular diagnostics.

A linear multivariate binary decision tree classifier based on K-means splitting

A novel tree kernel support vector machine classifier for modeling the relationship between bioactivity and molecular descriptors

A linear multivariate decision tree with branch-and-bound components

Novel Design of Decision-Tree-Based Support Vector Machines Multi-Class Classifier

Kernel KMeans clustering splits for end-to-end unsupervised decision trees

Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees

Efficient Tree Classifiers for Large Scale Datasets.

A New Classification Model Using a Decision Tree Generated from Hyperplanes in Dimensional Space

A Novel Decision Cluster Classifier with Nested Agglomerative K-Means

A New Method for Learning Decision Tree Classifier

Multi-class Classifier of Non-Linear SVM Decision Tree

Mixed-Integer Linear Optimization for Semi-Supervised Optimal Classification Trees

A New Multi-class Classification Based on Non-linear SVM and Decision Tree

Building decision trees for the multi-class imbalance problem

An Improved Binary Tree SVM for Multi-Classification

Nsvm Decision Tree for Multi-Class Classification

Tree Classifier in Spectral Space

BVDT: A Boosted Vector Decision Tree Algorithm for Multi-Class Classification Problems

Explaining Kernel Clustering via Decision Trees

Multiclass Decision Forest - A Novel Pattern Recognition Method For Multiclass Classification In Microarray Data Analysis

Discriminant analysis based on kernelized decision boundary for face recognition