Optimal Neighborhood Multiple Kernel Clustering with Adaptive Local Kernels
Jiyuan Liu,Xinwang Liu,Jian Xiong,Qing Liao,Sihang Zhou,Siwei Wang,Yuexiang Yang
DOI: https://doi.org/10.1109/tkde.2020.3014104
IF: 9.235
2021-01-01
IEEE Transactions on Knowledge and Data Engineering
Abstract:Multiple kernel clustering (MKC) algorithm aims to group data into different categories by optimally integrating information from a group of pre-specified kernels. Though demonstrating superiorities in various applications, we observe that existing MKC algorithms usually do not sufficiently consider the local density around individual data samples and excessively limit the representation capacity of the learned optimal kernel, leading to unsatisfying performance. In this paper, we propose an algorithm, called optimal neighborhood MKC with adaptive local kernels (ON-ALK), to address the two issues. In specific, we construct adaptive local kernels to sufficiently consider the local density around individual data samples, where different numbers of neighbors are discriminatingly selected on each sample. Further, the proposed ON-ALK algorithm boosts the representation of the learned optimal kernel via relaxing it into the neighborhood area of weighted combination of the pre-specified kernels. To solve the resultant optimization problem, a three-step iterative algorithm is designed and theoretically proven to be convergent. After that, we also study the generalization bound of the proposed algorithm. Extensive experiments have been conducted to evaluate the clustering performance. As indicated, the algorithm significantly outperforms state-of-the-art methods in recent literatures on six challenging benchmark datasets, verifying its advantages and effectiveness.
computer science, information systems, artificial intelligence,engineering, electrical & electronic