Multi-task Twin Bounded Support Vector Machine and Its Safe Screening Rule.

Ran An,Yitian Xu,Xuhua Liu
DOI: https://doi.org/10.1016/j.asoc.2023.110188
IF: 8.7
2023-01-01
Applied Soft Computing
Abstract:Direct multi-task twin support vector machine (DMTSVM) obtains great performance in dealing with correlated tasks. However, DMTSVM only considers the empirical risk minimization principle, so it readily causes over-fitting and lowers the prediction accuracy. To enhance the generalization ability of the classifier, we construct a multi-task twin bounded support vector machine (MT-TBSVM), in which a regularization term is introduced into the objective function, thus implementing the structural risk minimization principle. To improve the computational speed of MT-TBSVM, we additionally put forward a safe screening rule (SSR) for it. SSR could identify most inactive samples from the multiple tasks. Therefore, this will result in a significant reduction in the scale of dual problems, meanwhile the testing accuracy keeps unchanged since it does not sacrifice the optimal solution. Moreover, a fast DCDM algorithm is presented for further solving the reduced MT-TBSVM. On fifteen benchmark datasets, numerical experimental results clearly demonstrated the effectiveness of proposed algorithms. Finally, the proposed method is applied to a real Chinese wine dataset to further investigate its validity.
What problem does this paper attempt to address?