Abstract:We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM). It extends the widely used supervised kernel alignment criterion to multi-kernel clustering. Our criterion is given by an intractable minimization-maximization problem in the kernel coefficient and clustering partition matrix. To optimize it, we equivalently rewrite the minimization-maximization formulation as a minimization of an optimal value function, prove its differenentiablity, and design a reduced gradient descent algorithm to decrease it. Furthermore, we prove that the resultant solution of SimpleMKKM is the global optimum. We theoretically analyze the performance of SimpleMKKM in terms of its clustering generalization error. After that, we develop extensive experiments to investigate the proposed SimpleMKKM from the perspectives of clustering accuracy, advantage on the formulation and optimization, variation of the learned consensus clustering matrix with iterations, clustering performance with varied number of samples and base kernels, analysis of the learned kernel weight, the running time and the global convergence. The experimental study demonstrates the effectiveness of the proposed SimpleMKKM by considerably and consistently outperforming state of the art multiple kernel clustering alternatives. In addition, the ablation study shows that the improved clustering performance is contributed by both the novel formulation and new optimization. Our work provides a more effective approach to integrate multi-view data for clustering, and this could trigger novel research on multiple kernel clustering. The source code and data for SimpleMKKM are available at https://github.com/xinwangliu/SimpleMKKMcodes/.

Unified and View-Specific Multiple Kernel K-Means Clustering.

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

Projective Multiple Kernel Subspace Clustering.

Subspace Segmentation-Based Robust Multiple Kernel Clustering

Multiple Kernel K-Means with Incomplete Kernels

Multiple Kernel Learning Based Multi-view Spectral Clustering

Robust Contrastive Multi-view Kernel Clustering

Multiple Kernel Low-Rank Representation-Based Robust Multi-View Subspace Clustering

Multiple Kernel Clustering Framework with Improved Kernels

Kernelized multi-view subspace clustering via auto-weighted graph learning

Efficient and Effective Incomplete Multi-View Clustering

SimpleMKKM: Simple Multiple Kernel K-Means

Efficient and Effective Regularized Incomplete Multi-view Clustering

Multiple Kernel Clustering with Local Kernel Reconstruction and Global Heat Diffusion

Multiple Kernel Clustering With Neighbor-Kernel Subspace Segmentation

Auto-weighted Multi-View Clustering Via Kernelized Graph Learning

Multi-View Multiple Clustering

Simple multiple kernel k-means with kernel weight regularization

Simultaneous Global and Local Graph Structure Preserving for Multiple Kernel Clustering

Robust Multi-View Subspace Clustering Via Weighted Multi-Kernel Learning and Co-Regularization

Multiple Kernel Clustering with Adaptive Multi-scale Partition Selection