Abstract:For existing kernel learning based semi-supervised clustering algorithms, it is generally difficult to scale well with large scale datasets and robust pairwise constraints. In this paper, we propose a new Non-Parametric Kernel Learning ( NPKL ) framework to deal with these problems. We generalize the graph embedding framework into kernel learning, by reforming it as a semi-definitive programming ( SDP ) problem, smoothing and avoiding over-smoothing the functional Hilbert space with Laplacian regularization. We propose two algorithms to solve this problem. One is a straightforward algorithm using SDP to solve the original kernel learning problem, dented as TRAnsductive Graph Embedding Kernel ( TRAGEK ) learning; the other is to relax the SDP problem and solve it with a constrained gradient descent algorithm. To accelerate the learning speed, we further divide the data into groups and used the sub-kernels of these groups to approximate the whole kernel matrix. This algorithm is denoted as Efficient Non-PArametric Kernel Learning ( ENPAKL ). The advantages of the proposed NPKL framework are (1) supervised information in the form of pairwise constraints can be easily incorporated; (2) it is robust to the number of pairwise constraints, i.e., the number of constraints does not affect the running time too much; (3) ENPAKL is efficient to some extent compared to some related kernel learning algorithms since it is a constraint gradient descent based algorithm. Experiments for clustering based on the learned kernels show that the proposed framework scales well with the size of datasets and the number of pairwise constraints. Further experiments for image segmentation indicate the potential advantages of the proposed algorithms over the traditional k-means and N-cut clustering algorithms for image segmentation in term of segmentation accuracy.

Unsupervised Non-Parametric Kernel Learning Algorithm

Unsupervised Multiple Kernel Learning

Non-Parametric Kernel Learning with robust pairwise constraints

Self-representative kernel concept factorization

Maximum Margin Based Semi-supervised Spectral Kernel Learning.

Adaptive Kernel Principal Component Analysis with Unsupervised Learning of Kernels

An Adaptive Approach to Learning Optimal Neighborhood Kernels.

Self-supervised Adaptive Kernel Nonnegative Matrix Factorization.

Learning the kernel matrix by resampling.

Spectral Transformation Approaches to Semi-supervised Learning

Nonlinear Hyperspectral Unmixing Based on Constrained Multiple Kernel NMF

Spectral Kernel Learning for Semi-Supervised Classification.

Semi-Supervised Low-Rank Kernel Learning Algorithm Based on Sparse Coding

Multiple Kernel Subspace Learning for Clustering and Classification

A General Kernelization Framework for Learning Algorithms Based on Kernel PCA.

Unsupervised Neighborhood Component Analysis for Clustering.

RKHS reconstruction based on manifold learning for high-dimensional data

Semi-supervised kernel minimum squared error based on manifold structure

Unsupervised kernel learning for abnormal events detection

Kernel Density Metric Learning

Unsupervised Discriminative Feature Selection in a Kernel Space Via L2, 1-Norm Minimization.