Kernel method for matrix completion with side information and its application in multi-label learning

Miao XU,Zhi-Hua ZHOU
DOI: https://doi.org/10.1360/N112016-00279
2018-01-01
Abstract:In practical machine learning,one instance is always associated with multiple labels.However,due to high cost,it is difficult to acquire the full supervised information for multi-label data.Thus,multi-label learning faces the problem of missing supervised information.By considering missing labels as unobserved entries in a matrix and features as side information,the matrix completion algorithm can be exploited to solve the missingsupervised-information problem in multi-label learning.While the previous research often focused on the case where data is linearly separable,in this paper,we propose the KernelMaxide algorithm,which not only exploits the nonlinear structure in the missing-supervised-information multi-label data,but also considers the correlation between labels.In particular,we construct a novel optimization objective based on the kernel matrix,using the Representer Theorem of Matrix Norm.We further use the Nystr(o)m method to reduce the memory and computational burden on the kernel matrix.Experiments show the merit of our proposal.
What problem does this paper attempt to address?