GL-TSVM: A robust and smooth twin support vector machine with guardian loss function

Mushir Akhtar,M. Tanveer,Mohd. Arshad

2024-08-29

Abstract:Twin support vector machine (TSVM), a variant of support vector machine (SVM), has garnered significant attention due to its $3/4$ times lower computational complexity compared to SVM. However, due to the utilization of the hinge loss function, TSVM is sensitive to outliers or noise. To remedy it, we introduce the guardian loss (G-loss), a novel loss function distinguished by its asymmetric, bounded, and smooth characteristics. We then fuse the proposed G-loss function into the TSVM and yield a robust and smooth classifier termed GL-TSVM. Further, to adhere to the structural risk minimization (SRM) principle and reduce overfitting, we incorporate a regularization term into the objective function of GL-TSVM. To address the optimization challenges of GL-TSVM, we devise an efficient iterative algorithm. The experimental analysis on UCI and KEEL datasets substantiates the effectiveness of the proposed GL-TSVM in comparison to the baseline models. Moreover, to showcase the efficacy of the proposed GL-TSVM in the biomedical domain, we evaluated it on the breast cancer (BreaKHis) and schizophrenia datasets. The outcomes strongly demonstrate the competitiveness of the proposed GL-TSVM against the baseline models.

Machine Learning

What problem does this paper attempt to address?

The paper aims to address the sensitivity of Twin Support Vector Machine (TSVM) when dealing with noise or outliers. Specifically:

1. **Propose a new loss function**: The paper introduces a new loss function called Guardian Loss (G-loss), which is asymmetric, bounded, and smooth, to enhance the model's robustness when facing noise or outliers.

2. **Improve the TSVM model**: By incorporating the G-loss function into TSVM, a new robust and smooth classifier called GL-TSVM is developed. This model not only improves robustness but also reduces overfitting by adding a regularization term.

3. **Optimize algorithm design**: To address the optimization challenges of GL-TSVM, the paper designs an efficient iterative algorithm and demonstrates its effectiveness on multiple benchmark datasets.

4. **Experimental validation**: Through experimental analysis on datasets such as UCI and KEEL, the superior performance of GL-TSVM compared to other baseline models is showcased. Additionally, its application on breast cancer (BreaKHis) and schizophrenia datasets further proves the model's competitiveness in the biomedical field.

In summary, the main goal of the paper is to enhance TSVM's performance in handling noise and outliers by introducing the G-loss function and optimization algorithm, and to demonstrate its advantages in practical application scenarios.