Abstract:Spectral clustering (SC) has been proven to be effective in various applications. However, the learning scheme of SC is suboptimal in that it learns the cluster indicator from a fixed graph structure, which usually requires a rounding procedure to further partition the data. Also, the obtained cluster number cannot reflect the ground truth number of connected components in the graph. To alleviate these drawbacks, we propose a rank-constrained SC with flexible embedding framework. Specifically, an adaptive probabilistic neighborhood learning process is employed to recover the block-diagonal affinity matrix of an ideal graph. Meanwhile, a flexible embedding scheme is learned to unravel the intrinsic cluster structure in low-dimensional subspace, where the irrelevant information and noise in high-dimensional data have been effectively suppressed. The proposed method is superior to previous SC methods in that: 1) the block-diagonal affinity matrix learned simultaneously with the adaptive graph construction process, more explicitly induces the cluster membership without further discretization; 2) the number of clusters is guaranteed to converge to the ground truth via a rank constraint on the Laplacian matrix; and 3) the mismatch between the embedded feature and the projected feature allows more freedom for finding the proper cluster structure in the low-dimensional subspace as well as learning the corresponding projection matrix. Experimental results on both synthetic and real-world data sets demonstrate the promising performance of the proposed algorithm.

Spectral Clustering on Subspace for Parameter Estimation of Jump Linear Models

Regime Switching Model Estimation: Spectral Clustering Hidden Markov Model

Multivariate Regime Switching Model Estimation and Asset Allocation

A Noise-Resistant Clustering Algorithm for Switching Regression Models

Double Smoothed Volatility Estimation of Potentially Non‐stationary Jump‐diffusion Model of Shibor

A Subspace Technique for The Identification of Switched Affine Models

Distributed debiased estimation of high-dimensional partially linear models with jumps

Identification of jump Markov linear models using particle filters

Subspace Identification for Continuous-Time Errors-in-variables Model from Sampled Data

Parameters Inference for Nonlinear Wave Equations with Markovian Switching

Jump Clustering, Information Flows, and Stock Price Efficiency

Estimation for Piecewise Homogeneous Markov Jump Systems: A Dual Hidden Markov Model Approach

Resilient Asynchronous State Estimation for Markovian Jump Neural Networks Subject to Stochastic Nonlinearities and Sensor Saturations

Rank-Constrained Spectral Clustering with Flexible Embedding

Spectral clustering with variance information for group structure estimation in panel data

Spectral learning of Bernoulli linear dynamical systems models for decision-making

Sequential sparse Bayesian learning with applications to system identification for damage assessment and recursive reconstruction of image sequences

Discrete and Balanced Spectral Clustering with Scalability

Fundamental Limits of Spectral Clustering in Stochastic Block Models

Block-Sparsity-Induced Adaptive Filter for Multi-Clustering System Identification

Sparse Parameter Identification for Stochastic Systems Based on [math] Regularization