Abstract:One of the major difficulties in machine learning methods is categorizing datasets that are imbalanced. This problem may lead to biased models, where the training process is dominated by the majority class, resulting in inadequate representation of the minority class. Universum twin support vector machine (UTSVM) produces a biased model towards the majority class, as a result, its performance on the minority class is often poor as it might be mistakenly classified as noise. Moreover, UTSVM is not proficient in handling datasets that contain outliers and noises. Inspired by the concept of incorporating prior information about the data and employing an intuitionistic fuzzy membership scheme, we propose intuitionistic fuzzy universum twin support vector machines for imbalanced data (IFUTSVM-ID). We use an intuitionistic fuzzy membership scheme to mitigate the impact of noise and outliers. Moreover, to tackle the problem of imbalanced class distribution, data oversampling and undersampling methods are utilized. Prior knowledge about the data is provided by universum data. This leads to better generalization performance. UTSVM is susceptible to overfitting risks due to the omission of the structural risk minimization (SRM) principle in their primal formulations. However, the proposed IFUTSVM-ID model incorporates the SRM principle through the incorporation of regularization terms, effectively addressing the issue of overfitting. We conduct a comprehensive evaluation of the proposed IFUTSVM-ID model on benchmark datasets from KEEL and compare it with existing baseline models. Furthermore, to assess the effectiveness of the proposed IFUTSVM-ID model in diagnosing Alzheimer's disease (AD), we applied them to the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Experimental results showcase the superiority of the proposed IFUTSVM-ID models compared to the baseline models.

Image classification via SVM using in-between universum samples

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Automatic Product Images Classification With Two Layers of SVM Classifier

Support Vector Machine Based 3D Object Recognition in a Virtual Environment

Selecting informative universum sample for semi-supervised learning

Semi-Supervised Classification with Universum

Multiclass Universum SVM

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

SVM Classification:Its Contents and Challenges

Feature selection by Universum embedding

Granular Ball Twin Support Vector Machine with Universum Data

Probability fuzzy SVM for image retrieval

Intuitionistic Fuzzy Universum Twin Support Vector Machine for Imbalanced Data

Kernel-Free Universum Quadratic Surface Twin Support Vector Machines for Imbalanced Data

A Novel Transductive Svm for Semisupervised Classification of Remote-Sensing Images

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Intuitionistic fuzzy multi-view support vector machines with universum data

Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

Content-Based Image Orientation Detection with Support Vector Machines

A New Sampling-Based Svm For Face Recognition

Automatic image annotation by incorporating feature hierarchy and boosting to scale up SVM classifiers.