Abstract:One of the major difficulties in machine learning methods is categorizing datasets that are imbalanced. This problem may lead to biased models, where the training process is dominated by the majority class, resulting in inadequate representation of the minority class. Universum twin support vector machine (UTSVM) produces a biased model towards the majority class, as a result, its performance on the minority class is often poor as it might be mistakenly classified as noise. Moreover, UTSVM is not proficient in handling datasets that contain outliers and noises. Inspired by the concept of incorporating prior information about the data and employing an intuitionistic fuzzy membership scheme, we propose intuitionistic fuzzy universum twin support vector machines for imbalanced data (IFUTSVM-ID). We use an intuitionistic fuzzy membership scheme to mitigate the impact of noise and outliers. Moreover, to tackle the problem of imbalanced class distribution, data oversampling and undersampling methods are utilized. Prior knowledge about the data is provided by universum data. This leads to better generalization performance. UTSVM is susceptible to overfitting risks due to the omission of the structural risk minimization (SRM) principle in their primal formulations. However, the proposed IFUTSVM-ID model incorporates the SRM principle through the incorporation of regularization terms, effectively addressing the issue of overfitting. We conduct a comprehensive evaluation of the proposed IFUTSVM-ID model on benchmark datasets from KEEL and compare it with existing baseline models. Furthermore, to assess the effectiveness of the proposed IFUTSVM-ID model in diagnosing Alzheimer's disease (AD), we applied them to the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Experimental results showcase the superiority of the proposed IFUTSVM-ID models compared to the baseline models.

Intuitionistic fuzzy multi-view support vector machines with universum data

Multi-view universum support vector machines with insensitive pinball loss

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

Multi-view Heterogeneous Fusion and Embedding for Categorical Attributes on Mixed Data.

Multi-View Scaling Support Vector Machines for Classification and Feature Selection.

Intuitionistic Fuzzy Universum Twin Support Vector Machine for Imbalanced Data

Multiview learning with twin parametric margin SVM

A new multi-task learning method with universum data

Creating Universum for class imbalance via locality and its application in multiview subspace learning

Fast multi-view twin hypersphere support vector machine with consensus and complementary principles

Unified View Imputation and Feature Selection Learning for Incomplete Multi-view Data

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering

Multi-task twin support vector machine with Universum data

Exploring and Exploiting Uncertainty for Incomplete Multi-View Classification

Adaptive unsupervised multi-view feature selection for visual concept recognition

Feature selection by Universum embedding

Iterative Multiview Subspace Learning for Unpaired Multiview Clustering

Multiclass Universum SVM

Unsupervised Cross-View Feature Selection on incomplete data

Multi-View Intact Space Learning

Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis.