Abstract:Spectral clustering is a very popular graph-based clustering technique that partitions data groups based on the input data similarity matrix. Many past studies based on spectral clustering, however, do not consider the global discriminative structure of the dataset. Also, the benefits of using more than one kernel have not been fully exploited with respect to spectral clustering, although it has been established by these past studies that using more than one kernel in clustering can result in a more accurate clustering than those obtained with a single kernel. Multi-kernel approaches, however, tend to be more time consuming compared to single kernel methods. To compensate these drawbacks, we integrate a global discriminative term into the clustering with an adaptive neighbor framework. This is done to preserve both the global geometric information and global discriminative information in a dual kernel space, in an attempt to optimize clustering performance. Via co-regularization, we utilize more than one kernel space to take advantage of the benefits of multiple kernels. We, however, use two heterogeneous kernels to help us reduce clustering time, since the ability to quickly process data is as equally important as its accuracy in this era of information explosion. Since these different kernel spaces admit the same underlying clustering of the data, we approach the problem looking for clustering consistent across the two kernel views. Hence we are able to detect the non-linear intrinsic geometrical information of the dataset. We perform clustering using the obtained indicator matrix from our modified Laplacian utilizing k-means. Our Experimental outcomes show that our approach gives satisfactory results in terms of accuracy and NMI, with time-to-cluster savings in comparison to other state-of-the-art clustering methods using both synthetic and public datasets.

Discriminant and cluster analysis for Gaussian stationary processes: local linear fitting approach

New Linear Discriminant Analysis Based on Gaussian Mixture Model

Nonlinear discriminant clustering based on spectral regularization

FEMDA: a unified framework for discriminant analysis

Global discriminative-based nonnegative spectral clustering.

Discriminant Analysis by Gaussian Mixtures

Discriminant functions arising from selection distributions: theory and simulation

Discriminative K-Means Laplacian Clustering

Spectral Clustering Based Null Space Linear Discriminant Analysis (Snlda)

Co-Regularized Discriminative Spectral Clustering with Adaptive Similarity Measure in Dual-Kernel Space

Optimal projections for Gaussian discriminants

The Geometry of Nonlinear Embeddings in Kernel Discriminant Analysis

Nonstationary Gaussian Process Discriminant Analysis With Variable Selection for High-Dimensional Functional Data

Discriminant Analysis of Distributional Data viaFractional Programming

A Regularized Nonlinear Discrimination Approach

Discrete Nonnegative Spectral Clustering

Nonnegative Spectral Clustering with Discriminative Regularization.

Multiclass Spectral Clustering Based on Discriminant Analysis

Improving model choice in classification: an approach based on clustering of covariance matrices

A Novel Spectral Clustering Algorithm Based on Neighbor Relation and Gaussian Kernel Function with Only One Parameter