Multi-label weighted k-nearest neighbor classifier with adaptive weight estimation

Jianhua Xu
DOI: https://doi.org/10.1007/978-3-642-24958-7_10
2011-01-01
Abstract:Multi-label classification is a special learning task in which any instance is possibly associated with multiple classes simultaneously. How to design and implement efficient and effective multi-label algorithms is a challenging issue. The k-nearest neighbor (kNN) method and its weighted form (WkNN) are simple but effective for binary and multi-class classification. In this paper, we construct a weighted kNN version for multi-label classification (MLC-WkNN) according to Bayesian theorem. Through approximating a query instance by the linear weighted sum of k-nearest neighbors in terms of least squared error, the weights are determined adaptively by solving a quadratic programming with a unit simplex constraint. Specially, our MLC-WkNN is still a model-free and instance-based learning technique and only involves a tunable parameter k. Experimental study on two benchmark data sets (Image and Yeast) illustrates that our MLC-WkNN outperforms seven existing high-performed multi-label algorithms.
What problem does this paper attempt to address?