Abstract:We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM). It extends the widely used supervised kernel alignment criterion to multi-kernel clustering. Our criterion is given by an intractable minimization-maximization problem in the kernel coefficient and clustering partition matrix. To optimize it, we equivalently rewrite the minimization-maximization formulation as a minimization of an optimal value function, prove its differenentiablity, and design a reduced gradient descent algorithm to decrease it. Furthermore, we prove that the resultant solution of SimpleMKKM is the global optimum. We theoretically analyze the performance of SimpleMKKM in terms of its clustering generalization error. After that, we develop extensive experiments to investigate the proposed SimpleMKKM from the perspectives of clustering accuracy, advantage on the formulation and optimization, variation of the learned consensus clustering matrix with iterations, clustering performance with varied number of samples and base kernels, analysis of the learned kernel weight, the running time and the global convergence. The experimental study demonstrates the effectiveness of the proposed SimpleMKKM by considerably and consistently outperforming state of the art multiple kernel clustering alternatives. In addition, the ablation study shows that the improved clustering performance is contributed by both the novel formulation and new optimization. Our work provides a more effective approach to integrate multi-view data for clustering, and this could trigger novel research on multiple kernel clustering. The source code and data for SimpleMKKM are available at https://github.com/xinwangliu/SimpleMKKMcodes/.

Kernel Mse Algorithm: A Unified Framework for Kfd, Ls-Svm and Krr

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Extreme Learning Machine with Multiple Kernels

Regularized Kernel Forms of Minimum Squared Error Method

Kernel Least-Mean Mixed-Norm Algorithm

Kimel: A Kernel Incremental Metalearning Algorithm

A Novel Kernel-Based Maximum a Posteriori Classification Method

SimpleMKKM: Simple Multiple Kernel K-Means

Regularized Regression Problem in hyper-RKHS for Learning Kernels

Kernel Regression with Sparse Metric Learning

Simple multiple kernel k-means with kernel weight regularization

Gauss-like Logarithmic Kernel Function to improve the performance of kernel machines on the small datasets

Rapid and brief communication: Learning the kernel parameters in kernel minimum distance classifier

Design of a Multiple Kernel Learning Algorithm for LS-SVM by Convex Programming

A General Kernelization Framework for Learning Algorithms Based on Kernel PCA.

Regularized Simple Multiple Kernel $k$-Means With Kernel Average Alignment

An efficient multiple kernel computation method for regression analysis of economic data

An efficient Kernel-based matrixized least squares support vector machine

Learning the kernel parameters in kernel minimum distance classifier

Multiple Locally Linear Kernel Machines