Parallel multiple kernel learning

ChenZhen-Yu,FanZhi-Ping

IF: 2.7

2014-01-01

Knowledge and Information Systems

Abstract:Multiple kernel learning (MKL) has recently become a hot topic in kernel methods. However, many MKL algorithms suffer from high computational cost. Moreover, standard MKL algorithms face the challe...

What problem does this paper attempt to address?

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Lin Luo,Hongye Su,Baofen Zheng,Junfeng Zhang

DOI: https://doi.org/10.3233/ifs-141149

2014-01-01

Journal of Intelligent & Fuzzy Systems

Abstract:In many applications of kernel method, such as support vector machine (SVM), the performance greatly depends on the choice of kernel. It is not always clear what is the most suitable kernel for one specified task. Multiple kernel learning (MKL) allows to optimize over linear combinations of kernels. A two-step approach, which alternately optimizes the standard SVM and kernel weights, is proposed to solve the non-convex MKL problem. The generalized convexity of MKL is studied which guarantees the strong duality of the corresponding optimization problem. A further contribution is the utilization of a computationally efficient inexact-projection-based method to optimize the standard SVM. In addition, a nonmonotone gradient method is proposed to optimize the kernel weights and the Hessian matrix is approximated with a variation of Limited-memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) approach. The global convergence of the proposed two-step approach is analyzed. The utility of the proposed scheme is demonstrated by empirical study with several datasets, and its performance is compared with state-of-the-art methods in terms of accuracy and scalability. The results show that the proposed method performs as well as existing methods in accuracy, but takes much less time to converge to the stationary point.
Extreme Learning Machine with Multiple Kernels

Li-juan Su,Min Yao

DOI: https://doi.org/10.1109/icca.2013.6565148

2013-01-01

Abstract:Recently a novel learning algorithm called extreme learning machine (ELM) was proposed for efficiently training single-hidden layer feedforward neural networks (SLFNs). Compared with other traditional gradient-descent-based learning algorithms, ELM has shown promising results because it chooses weights and biases of hidden nodes randomly and obtains the output weights and biases analytically. In most cases, ELM is fast and presents good generalization, but we find that the stability and generalization performance still can be improved. In this paper, we propose a hybrid model which combines the advantage of ELM and the advantage of Bayesian "sum of kernels" model, named Extreme Learning Machine with Multiple Kernels (MK-ELM). This method optimizes the kernel function using a weighted sum of kernel functions by a prior knowledge. Experimental results show that this approach is able to make neural networks more robust and generates better generalization performance for both regression and classification applications.
Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Xiaodong Li,Weijie Mao,Wei Jiang

DOI: https://doi.org/10.1007/s00521-014-1709-7

2016-01-01

Neural Computing and Applications

Abstract:The extreme learning machine (ELM) is a new method for using single hidden layer feed-forward networks with a much simpler training method. While conventional kernel-based classifiers are based on a single kernel, in reality, it is often desirable to base classifiers on combinations of multiple kernels. In this paper, we propose the issue of multiple-kernel learning (MKL) for ELM by formulating it as a semi-infinite linear programming. We further extend this idea by integrating with techniques of MKL. The kernel function in this ELM formulation no longer needs to be fixed, but can be automatically learned as a combination of multiple kernels. Two formulations of multiple-kernel classifiers are proposed. The first one is based on a convex combination of the given base kernels, while the second one uses a convex combination of the so-called equivalent kernels. Empirically, the second formulation is particularly competitive. Experiments on a large number of both toy and real-world data sets (including high-magnification sampling rate image data set) show that the resultant classifier is fast and accurate and can also be easily trained by simply changing linear program.
Two-stage multiple kernel learning with multiclass kernel polarization.

Tinghua Wang,Dongyan Zhao,Yansong Feng

DOI: https://doi.org/10.1016/j.knosys.2013.04.006

IF: 8.139

2013-01-01

Knowledge-Based Systems

Abstract:The success of kernel methods is very much dependent on the choice of kernels. Multiple kernel learning (MKL) aims at learning a combination of different kernels in order to better match the underlying problem instead of using a single fixed kernel. In this paper, we propose a simple but effective multiclass MKL method by a two-stage strategy, in which the first stage finds the kernel weights to combine the kernels, and the second stage trains a standard multiclass support vector machine (SVM). Specifically, we first present an evaluation criterion named multiclass kernel polarization (MKP) to assess the quality of a kernel in the multiclass classification scenario, and then develop a heuristic rule to directly assign a weight to each kernel based on the quality of the individual kernel. MKP is a multiclass extension of the kernel polarization, which is a universal kernel evaluation criterion for kernel design and learning. Comprehensive experiments are conducted on several UCI benchmark examples and the results well demonstrate the effectiveness and efficiency of our approach.
Unsupervised Multiple Kernel Learning

Jialei Wang,Jinfeng Zhuang,Steven C. H. Hoi

2011-01-01

Abstract:Traditional multiple kernel learning (MKL) algorithms are essentially supervised learning in the sense that the kernel learning task requires the class labels of training data. However, class labels may not always be available prior to the kernel learning task in some real world scenarios, e.g., an early preprocessing step of a classification task or an unsupervised learning task such as dimension reduction. In this paper, we investigate a problem of Unsupervised Multiple Kernel Learning (UMKL), which does not require class labels of training data as needed in a conventional multiple kernel learning task. Since a kernel essentially defines pairwise similarity between any two examples, our unsupervised kernel learning method mainly follows two intuitive principles: (1) a good kernel should allow every example to be well reconstructed from its localized bases weighted by the kernel values; (2) a good kernel should induce kernel values that are coincided with the local geometry of the data. We formulate the unsupervised multiple kernel learning problem as an optimization task and propose an efficient alternating optimization algorithm to solve it. Empirical results on both classification and dimension reductions tasks validate the efficacy of the proposed UMKL algorithm.
Non-uniform Multiple Kernel Learning with Cluster-Based Gating Functions

Yadong Mu,Bingfeng Zhou

DOI: https://doi.org/10.1016/j.neucom.2010.11.001

IF: 6

2010-01-01

Neurocomputing

Abstract:Recently, multiple kernel learning (MKL) has gained increasing attention due to its empirical superiority over traditional single kernel based methods. However, most of state-of-the-art MKL methods are ''uniform'' in the sense that the relative weights of kernels keep fixed among all data. Here we propose a ''non-uniform'' MKL method with a data-dependent gating mechanism, i.e., adaptively determine the kernel weights for the samples. We utilize a soft clustering algorithm and then tune the weight for each cluster under the graph embedding (GE) framework. The idea of exploiting cluster structures is based on the observation that data from the same cluster tend to perform consistently, which thus increases the resistance to noises and results in more reliable estimate. Moreover, it is computationally simple to handle out-of-sample data, whose implicit RKHS representations are modulated by the posterior to each cluster. Quantitative studies between the proposed method and some representative MKL methods are conducted on both synthetic and widely used public data sets. The experimental results well validate its superiorities.
Multi-kernel Graph Fusion for Spectral Clustering

Bo Zhou,Wenliang Liu,Wenzhen Zhang,Zhengyu Lu,Qianlin Tan

DOI: https://doi.org/10.1016/j.ipm.2022.103003

IF: 7.466

2022-01-01

Information Processing & Management

Abstract:Many methods of multi-kernel clustering have a bias to power base kernels by ignoring other kernels. To address this issue, in this paper, we propose a new method of multi-kernel graph fusion based on min–max optimization (namely MKGF-MM) for spectral clustering by making full use of all base kernels. Specifically, the proposed method investigates a novel min–max weight strategy to capture the complementary information among all base kernels. As a result, every base kernel contributes to the construction of the fusion graph from all base kernels so that the quality of the fusion graph is guaranteed. In addition, we design an iterative optimization method to solve the proposed objective function. Furthermore, we theoretically prove that our optimization method achieves convergence. Experimental results on real medical datasets and scientific datasets demonstrate that the proposed method outperforms all comparison methods and the proposed optimization method achieves fast convergence. • The min–max weight strategy improves the quality of the combined kernel and the fusion graph. • We theoretically and experimentally prove the convergence of our optimization method. • The optimization method can easily be applied in all kinds of cases.
Efficient sparse generalized multiple kernel learning

Haiqin Yang,Zenglin Xu,Jieping Ye,Irwin King,Michael R Lyu

DOI: https://doi.org/10.1109/TNN.2010.2103571

Abstract:Kernel methods have been successfully applied in various applications. To succeed in these applications, it is crucial to learn a good kernel representation, whose objective is to reveal the data similarity precisely. In this paper, we address the problem of multiple kernel learning (MKL), searching for the optimal kernel combination weights through maximizing a generalized performance measure. Most MKL methods employ the L(1)-norm simplex constraints on the kernel combination weights, which therefore involve a sparse but non-smooth solution for the kernel weights. Despite the success of their efficiency, they tend to discard informative complementary or orthogonal base kernels and yield degenerated generalization performance. Alternatively, imposing the L(p)-norm (p > 1) constraint on the kernel weights will keep all the information in the base kernels. This leads to non-sparse solutions and brings the risk of being sensitive to noise and incorporating redundant information. To tackle these problems, we propose a generalized MKL (GMKL) model by introducing an elastic-net-type constraint on the kernel weights. More specifically, it is an MKL model with a constraint on a linear combination of the L(1)-norm and the squared L(2)-norm on the kernel weights to seek the optimal kernel combination weights. Therefore, previous MKL problems based on the L(1)-norm or the L(2)-norm constraints can be regarded as special cases. Furthermore, our GMKL enjoys the favorable sparsity property on the solution and also facilitates the grouping effect. Moreover, the optimization of our GMKL is a convex optimization problem, where a local solution is the global optimal solution. We further derive a level method to efficiently solve the optimization problem. A series of experiments on both synthetic and real-world datasets have been conducted to show the effectiveness and efficiency of our GMKL.
Multiple Kernel Subspace Learning for Clustering and Classification

Ziqiu Chi,Zhe Wang,Bolu Wang,Zhongli Fang,Zonghai Zhu,Dongdong Li,Wenli Du

DOI: https://doi.org/10.1109/tkde.2022.3200723

IF: 9.235

2022-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:In the face of high-dimensional and complex data, effective subspace can preserve specific statistical properties and provide an appropriate representation of data, which generally facilitates the underlying tasks such as clustering or classification. Meanwhile, multiple kernel learning is a technique to combine multiple kernels from different feature spaces effectively. Thus, by incorporating multiple kernels into the process of subspace learning, different feature spaces can be projected into a unified subspace. This article proposes the Multiple Kernel Subspace Learning (MKSL) for embedding the original space into a unified subspace. Multiple kernels of different feature spaces are combined by MKSL in the process of learning, which can extend the suitability for various applications. Moreover, to generate the optimal combination kernel of subspace learning, we propose a two-step iteration strategy to learn the appropriate kernel weights and transformation matrix of projecting simultaneously. Furthermore, our proposed formulation of MKSL can introduce different prior knowledge such as class information and neighborhood relationships. Thus it is competent to the unsupervised learning, semi-supervised learning, and supervised learning. Extensive experiments are conducted on diverse datasets, and the performances are comprehensively evaluated on different tasks. The experimental results indicate that the proposed algorithm is outstanding in unsupervised clustering task and effective in supervised and semi-supervised classification tasks.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
Multiple Kernel Clustering Based on Centered Kernel Alignment

Yanting Lu,Liantao Wang,Jianfeng Lu,Jingyu Yang,Chunhua Shen

DOI: https://doi.org/10.1016/j.patcog.2014.05.005

IF: 8

2014-01-01

Pattern Recognition

Abstract:Multiple kernel clustering (MKC), which performs kernel-based data fusion for data clustering, is an emerging topic. It aims at solving clustering problems with multiple cues. Most MKC methods usually extend existing clustering methods with a multiple kernel learning (MKL) setting. In this paper, we propose a novel MKC method that is different from those popular approaches. Centered kernel alignment-an effective kernel evaluation measure-is employed in order to unify the two tasks of clustering and MKL into a single optimization framework. To solve the formulated optimization problem, an efficient two-step iterative algorithm is developed. Experiments on several UCI datasets and face image datasets validate the effectiveness and efficiency of our MKC algorithm.
An Online Multiple Kernel Parallelizable Learning Scheme

Emilio Ruiz-Moreno,Baltasar Beferull-Lozano

2023-11-06

Abstract:The performance of reproducing kernel Hilbert space-based methods is known to be sensitive to the choice of the reproducing kernel. Choosing an adequate reproducing kernel can be challenging and computationally demanding, especially in data-rich tasks without prior information about the solution domain. In this paper, we propose a learning scheme that scalably combines several single kernel-based online methods to reduce the kernel-selection bias. The proposed learning scheme applies to any task formulated as a regularized empirical risk minimization convex problem. More specifically, our learning scheme is based on a multi-kernel learning formulation that can be applied to widen any single-kernel solution space, thus increasing the possibility of finding higher-performance solutions. In addition, it is parallelizable, allowing for the distribution of the computational load across different computing units. We show experimentally that the proposed learning scheme outperforms the combined single-kernel online methods separately in terms of the cumulative regularized least squares cost metric.

Machine Learning,Signal Processing
Bridging deep and multiple kernel learning: A review

Tinghua Wang,Lin Zhang,Wenyu Hu

DOI: https://doi.org/10.1016/j.inffus.2020.10.002

IF: 18.6

2021-03-01

Information Fusion

Abstract:Kernel methods and deep learning are two of the most currently remarkable machine learning techniques that have achieved great success in many applications. Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the reproducing kernel Hilbert space (RKHS) while making the computation tractable by leveraging the kernel trick. It is commonly agreed that the success of kernel methods is very much dependent on the choice of kernel. Multiple kernel learning (MKL) is one possible scheme that performs kernel combination and selection for a variety of learning tasks, such as classification, clustering, and dimensionality reduction. Deep learning models project input data through several layers of nonlinearity and learn different levels of abstraction. The composition of multiple layers of nonlinear functions can approximate a rich set of naturally occurring input-output dependencies. To bridge kernel methods and deep learning, deep kernel learning has been proven to be an effective method to learn complex feature representations by combining the nonparametric flexibility of kernel methods with the structural properties of deep learning. This article presents a comprehensive overview of the state-of-the-art approaches that bridge the MKL and deep learning techniques. Specifically, we systematically review the typical hybrid models, training techniques, and their theoretical and practical benefits, followed by remaining challenges and future directions. We hope that our perspectives and discussions serve as valuable references for new practitioners and theoreticians seeking to innovate in the applications of the approaches incorporating the advantages of both paradigms and exploring new synergies.

computer science, artificial intelligence, theory & methods
Consensus Local Graph for Multiple Kernel Clustering

Zheng Liu,Shiluo Huang,Wei Jin,Ying Mu

DOI: https://doi.org/10.1016/j.neucom.2024.128252

IF: 6

2024-01-01

Neurocomputing

Abstract:Due to the ability to represent the relationship among data, graph has received extensive attention in clustering field. As illustrated by existing studies, learning graph in kernel space is an effective way to capture the structure of data. Among kernel-based methods, multiple kernel learning (MKL) is increasingly popular since it can automatically utilize the complementary information contained in base kernels. Although many existing MKL-based graph learning algorithms have promising learning abilities, we observe that they (1) put too much attention on learning the consensus kernel which probably contains lots of redundant information and loses the diversity of base kernels; (2) ignore the local structure of the representations in multiple kernel spaces. To eliminate the bad effect of these issues, we propose a novel graph learning method, termed consensus local graph based on MKL (CLGMKL), for clustering. In CLGMKL, a low-rank kernel matrix is used to extract the discriminative information of each base kernel and a local graph is constructed to capture the local structure contained in each new kernel. Then CLGMKL combines these local graphs in a self-weighed way. Since the above processes are associated with each other, we jointly optimize them to obtain the overall optimality. An effective learning scheme with proved convergence is developed to optimize the combined objective function. Finally, extensive experiments on some popular datasets are conducted to test the effectiveness of the presented method. As illustrated, CLGMKL is more competitive than the state-of-the-art algorithms.
Multiple Kernel Active Learning for Image Classification

Jingjing Yang,Yuanning Li,Yonghong Tian,Lingyu Duan,Wen Gao

DOI: https://doi.org/10.1109/icme.2009.5202555

2009-01-01

Abstract:Recently, multiple kernel learning (MKL) methods have shown promising performance in image classification. As a sort of supervised learning, training MKL-based classifiers relies on selecting and annotating extensive dataset. In general, we have to manually label large amount of samples to achieve desirable MKL-based classifiers. Moreover, MKL also suffers a great computational cost on kernel computation and parameter optimization. In this paper, we propose a local adaptive active learning (LA-AL) method to reduce the labeling and computational cost by selecting the most informative training samples. LA-AL adopts a top-down (or global-local) strategy for locating and searching informative samples. Uncertain samples are first clustered into groups, and then informative samples are consequently selected via inter-group and intra-group competitions. Experiments over COREL-5K show that the proposed LA-AL method can significantly reduce the demand of sample labeling and have achieved the state-of-the-art performance.
Local kernels based graph learning for multiple kernel clustering

Zheng Liu,Shiluo Huang,Wei Jin,Ying Mu

DOI: https://doi.org/10.1016/j.patcog.2024.110300

IF: 8

2024-02-05

Pattern Recognition

Abstract:Multiple kernel clustering (MKC) has been extensively studied in recent years. The focus of MKC is how to explore the information of base kernels. Although existing methods have promising leaning abilities, they ignore the intrinsic local structure contained in base kernels, which may negatively affect their performances. To address the above problem, a novel method, termed as consensus graph learning based on local kernels (CGLLK), is introduced. CGLLK is based on the partitions extracted by kernel k-means. Specifically, we first design a simple yet effective scheme to construct the local kernels of base kernels and then a consensus graph is applied to capture the complementary information contained in the extracted partitions of local kernels. CGLLK also considers the prior knowledge existing in base kernels. Since the partitions of local kernels and the learning stage of the consensus graph contain useful information for each other, the two processes are optimized jointly. Extensive experiments on some popular datasets are carried out to verify the effectiveness of the proposed method. Experimental results illustrate that CGLLK is much more competitive than the state-of-the-art algorithms.

computer science, artificial intelligence,engineering, electrical & electronic
Multiple Kernel Clustering with Kernel k-Means Coupled Graph Tensor Learning

Zhenwen Ren,Quansen Sun,Dong Wei

DOI: https://doi.org/10.1609/aaai.v35i11.17134

2021-05-18

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Kernel k-means (KKM) and spectral clustering (SC) are two basic methods used for multiple kernel clustering (MKC), which have both been widely used to identify clusters that are non-linearly separable. However, both of them have their own shortcomings: 1) the KKM-based methods usually focus on learning a discrete clustering indicator matrix via a combined consensus kernel, but cannot exploit the high-order affinities of all pre-defined base kernels; and 2) the SC-based methods require a robust and meaningful affinity graph in kernel space as input in order to form clusters with desired clustering structure. In this paper, a novel method, kernel k-means coupled graph tensor (KCGT), is proposed to graciously couple KKM and SC for seizing their merits and evading their demerits simultaneously. In specific, we innovatively develop a new graph learning paradigm by leveraging an explicit theoretical connection between clustering indicator matrix and affinity graph, such that the affinity graph propagated from KKM enjoys the valuable block diagonal and sparse property. Then, by using this graph learning paradigm, base kernels can produce multiple candidate affinity graphs, which are stacked into a low-rank graph tensor for capturing the high-order affinity of all these graphs. After that, by averaging all the frontal slices of the tensor, a high-quality affinity graph is obtained. Extensive experiments have shown the superiority of KCGT compared with the state-of-the-art MKC methods.
Multiple Kernel Clustering With Compressed Subspace Alignment

Sihang Zhou,Qiyuan Ou,Xinwang Liu,Siqi Wang,Luyan Liu,Siwei Wang,En Zhu,Jianping Yin,Xin Xu

DOI: https://doi.org/10.1109/tnnls.2021.3093426

IF: 14.255

2021-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Multiple kernel clustering (MKC) has recently achieved remarkable progress in fusing multisource information to boost the clustering performance. However, the O(n2) memory consumption and O(n3) computational complexity prohibit these methods from being applied into median- or large-scale applications, where n denotes the number of samples. To address these issues, we carefully redesign the formulation of subspace segmentation-based MKC, which reduces the memory and computational complexity to O(n) and O(n2) , respectively. The proposed algorithm adopts a novel sampling strategy to enhance the performance and accelerate the speed of MKC. Specifically, we first mathematically model the sampling process and then learn it simultaneously during the procedure of information fusion. By this way, the generated anchor point set can better serve data reconstruction across different views, leading to improved discriminative capability of the reconstruction matrix and boosted clustering performance. Although the integrated sampling process makes the proposed algorithm less efficient than the linear complexity algorithms, the elaborate formulation makes our algorithm straightforward for parallelization. Through the acceleration of GPU and multicore techniques, our algorithm achieves superior performance against the compared state-of-the-art methods on six datasets with comparable time cost to the linear complexity algorithms.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Neural Generalization of Multiple Kernel Learning

Ahmad Navid Ghanizadeh,Kamaledin Ghiasi-Shirazi,Reza Monsefi,Mohammadreza Qaraei

DOI: https://doi.org/10.1007/s11063-024-11516-0

IF: 2.565

2024-02-08

Neural Processing Letters

Abstract:Multiple Kernel Learning (MKL) is a conventional way to learn the kernel function in kernel-based methods. MKL algorithms enhance the performance of kernel methods. However, these methods have a lower complexity compared to deep models and are inferior to them regarding recognition accuracy. Deep learning models can learn complex functions by applying nonlinear transformations to data through several layers. In this paper, we show that a typical MKL algorithm can be interpreted as a one-layer neural network with linear activation functions. By this interpretation, we propose a Neural Generalization of Multiple Kernel Learning (NGMKL), which extends the conventional MKL framework to a multi-layer neural network with nonlinear activation functions. Our experiments show that the proposed method, which has a higher complexity than traditional MKL methods, leads to higher recognition accuracy on several benchmarks.

computer science, artificial intelligence
Multiple graph kernel learning based on GMDH-type neural network

Lixiang Xu,Lu Bai,Jin Xiao,Qi Liu,Enhong Chen,Xiaofeng Wang,Yuanyan Tang

DOI: https://doi.org/10.1016/j.inffus.2020.08.025

IF: 18.6

2021-02-01

Information Fusion

Abstract:Multiple kernel learning (MKL), as a principled classification method, selects and combines base kernels to increase the categorization accuracy of Support Vector Machines (SVMs). The group method of data handling neural network (GMDH-NN) has been applied in many fields of optimization, data mining, and pattern recognition. It can automatically seek interrelatedness in data, select an optimal structure for the model or network, and enhance the accuracy of existing algorithms. We can utilize the advantages of the GMDH-NN to build a multiple graph kernel learning (MGKL) method and enhance the categorization performance of graph kernel SVMs. In this paper, we first define a unitized symmetric regularity criterion (USRC) to improve the symmetric regularity criterion of GMDH-NN. Second, a novel structure for the initial model of the GMDH-NN is defined, which uses the posterior probability output of graph kernel SVMs. We then use a hybrid graph kernel in the <math>H1</math>-space for MGKL in combination with the GMDH-NN. This way, we can obtain a pool of optimal graph kernels with different kernel parameters. Our experiments on standard graph datasets show that this new MGKL method is highly effective.

computer science, artificial intelligence, theory & methods
SimpleMKKM: Simple Multiple Kernel K-Means

Xinwang Liu

DOI: https://doi.org/10.1109/tpami.2022.3198638

IF: 23.6

2023-03-11

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM). It extends the widely used supervised kernel alignment criterion to multi-kernel clustering. Our criterion is given by an intractable minimization-maximization problem in the kernel coefficient and clustering partition matrix. To optimize it, we equivalently rewrite the minimization-maximization formulation as a minimization of an optimal value function, prove its differenentiablity, and design a reduced gradient descent algorithm to decrease it. Furthermore, we prove that the resultant solution of SimpleMKKM is the global optimum. We theoretically analyze the performance of SimpleMKKM in terms of its clustering generalization error. After that, we develop extensive experiments to investigate the proposed SimpleMKKM from the perspectives of clustering accuracy, advantage on the formulation and optimization, variation of the learned consensus clustering matrix with iterations, clustering performance with varied number of samples and base kernels, analysis of the learned kernel weight, the running time and the global convergence. The experimental study demonstrates the effectiveness of the proposed SimpleMKKM by considerably and consistently outperforming state of the art multiple kernel clustering alternatives. In addition, the ablation study shows that the improved clustering performance is contributed by both the novel formulation and new optimization. Our work provides a more effective approach to integrate multi-view data for clustering, and this could trigger novel research on multiple kernel clustering. The source code and data for SimpleMKKM are available at https://github.com/xinwangliu/SimpleMKKMcodes/.

computer science, artificial intelligence,engineering, electrical & electronic

Parallel multiple kernel learning

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Extreme Learning Machine with Multiple Kernels

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Two-stage multiple kernel learning with multiclass kernel polarization.

Unsupervised Multiple Kernel Learning

Non-uniform Multiple Kernel Learning with Cluster-Based Gating Functions

Multi-kernel Graph Fusion for Spectral Clustering

Efficient sparse generalized multiple kernel learning

Multiple Kernel Subspace Learning for Clustering and Classification

Multiple Kernel Clustering Based on Centered Kernel Alignment

An Online Multiple Kernel Parallelizable Learning Scheme

Bridging deep and multiple kernel learning: A review

Consensus Local Graph for Multiple Kernel Clustering

Multiple Kernel Active Learning for Image Classification

Local kernels based graph learning for multiple kernel clustering

Multiple Kernel Clustering with Kernel k-Means Coupled Graph Tensor Learning

Multiple Kernel Clustering With Compressed Subspace Alignment

Neural Generalization of Multiple Kernel Learning

Multiple graph kernel learning based on GMDH-type neural network

SimpleMKKM: Simple Multiple Kernel K-Means