Abstract:Support vector machines (SVMs) are powerful supervised learning tools developed to solve classification problems. However, SVMs are likely to perform poorly in the classification of imbalanced data. The rough set theory presents a mathematical tool for inference in nondeterministic cases that provides methods for removing irrelevant information from data. In this work, we propose an approach that efficiently used fuzzy rough set theory in weighted least squares twin support vector machine called FRLSTSVM for classification of imbalanced data. The first innovation is introducing a new fuzzy rough set-based under-sampling strategy to make the classifier robust in terms of the imbalanced data. For constructing the two proximal hyperplanes in FRLSTSVM, data points from the minority class remain unchanged while a subset of data points in the majority class are selected using a new method. In this model, we embed the weight biases in the LSTSVM formulations to overcome the bias phenomenon in the original twin SVM for the classification of imbalanced data. In order to determine these weights in this formulation, we introduce a new strategy that uses fuzzy rough set theory as the second innovation. Experimental results on the famous imbalanced datasets, compared to the related traditional SVM-based methods, demonstrate the superiority of the proposed FRLSTSVM model in the imbalanced data classification.

Rough Set-Based Feature Weighted Kernels for Support Vector Machine

Weighted Support Vector Machines for Regression and Its Application

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

A Type-2 Fuzzy Logic Ensemble SVM Classifier Based on Feature Weighting

Weighted Support Vector Machine for Classification with Uneven Training Class Sizes

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

Improved Weighted Least Squares Support Vector Machines Algorithm And Its Applications In Spectroscopic Quantitative Analysis

Improved Kernel Method for Clustering Based on Fuzzy 1-SVM

A new algorithm of support vector machine based on weighted feature

Weighted Least Squares Twin Support Vector Machine with Fuzzy Rough Set Theory for Imbalanced Data Classification

A Rough Margin Based Support Vector Machine.

A rough margin based fuzzy support vector machine

Support Feature Machines

Kernel density weighted method of obtaining the least square support vector machines weightes

A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

Feature Rescaling of Support Vector Machines

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Fingerprint Matching Based on Weighting Method and the SVM

Study on Web Text Feature Selection Based on Rough Set.

Feature Selection for Support Vector Machines in Text Categorization