Abstract:For medical data mining, the development of a class prediction model has been widely used to deal with various kinds of data classification problems. Classification models especially for high-dimensional gene expression datasets have attracted many researchers in order to identify marker genes for distinguishing any type of cancer cells from their corresponding normal cells. However, skewed class distributions often occur in the medical datasets in which at least one of the classes has a relatively small number of observations. A classifier induced by such an imbalanced dataset typically has a high accuracy for the majority class and poor prediction for the minority class. In this study, we focus on an SVM classifier with a Gaussian radial basis kernel for a binary classification problem. In order to take advantage of an SVM and to achieve the best generalization ability for improving the classification performance, we will address two important problems: the class imbalance and parameter selection during SVM parameter optimization. First of all, we proposed a novel adjustment method called b-SVM, for adjusting the cutoff threshold of the SVM. Second, we proposed a fast and simple approach, called the Min-max gamma selection, to optimize the model parameters of SVMs without carrying out an extensive k-fold cross validation. An extensive comparison with a standard SVM and well-known existing methods are carried out to evaluate the performance of our proposed algorithms using simulated and real datasets. The experimental results show that our proposed algorithms outperform the over-sampling techniques and existing SVM-based solutions. This study also shows that the proposed Min-max gamma selection is at least 10 times faster than the cross-validation selection based on the average running time on six real datasets.

MaxMin-L2-SVC-NCH: A Novel Approach for Support Vector Classifier Training and Parameter Selection

Novel Linear Search for Support Vector Machine Parameter Selection

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

A Multi-Class Large Margin Classifier

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

A Fast Smoothing Newton Method for Bilevel Hyperparameter Optimization for SVC with Logistic Loss

Fast and Efficient Strategies for Model Selection of Gaussian Support Vector Machine

Efficient Model Selection for Support Vector Machine with Gaussian Kernel Function

SVM Parameter Selection Algorithm Based on Maximum Kernel Similarity Diversity

Parameter Optimization of LS-SVM for Regression Using NGA

Super-parameter Selection for Gaussian-Kernel SVM Based on Outlier-Resisting

Efficient Selection of Gaussian Kernel SVM Parameters for Imbalanced Data

Parameter Selection of SVM with Gaussian kernel

Design of a Multiple Kernel Learning Algorithm for LS-SVM by Convex Programming

Kernel Parameter Selection for Support Vector Machine Classification

Simple, fast and accurate hyper-parameter tuning in Gaussian-kernel SVM

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

Parameter Selection For Gaussian Radial Basis Function In Support Vector Machine Classification

Model Selection for Least Squares Support Vector Regressions Based on Small-World Strategy