Abstract:Graph regularized techniques have been extensively exploited in unsupervised learning. However, there exist no principled ways to select reasonable graphs and their associated hyper parameters, particularly in multiple heterogeneous data sources. Often, the graph selection process requires rather time-consuming cross-validation and discrete grid search that are not scalable to a large number of candidate graph sources. To address this issue, we propose a new formulation by integrating Ensemble Manifold structure into Low Rank approximation (EMLR). The central idea is to maximally approximate the intrinsic geometric structure by searching the optimal linear combination space of multiple different graphs. Specifically, efficient projection onto the probabilistic simplex is utilized to optimize the graph weights, resulting in the sparsity pattern of coefficients. This attractive property of sparsity can be properly interpreted as a criterion for selection of graphs, i.e., identifying most discriminative graphs and removing noisy or irrelevant graphs under the low rank decomposition model. Therefore, the compact output representation and linear combination coefficients of multiple different graphs can be simultaneously achieved by a unified objective. Exhaustive experimental results corroborate the effectiveness of our new model.

Graph Manifolds from Spectral Polynomials

Spectral Invariants and Their Application on Spectral Characterization of Graphs

Geometric structure of graph Laplacian embeddings

Graph Laplacians, Riemannian Manifolds and Their Machine-Learning

Structure of the chromatic polynomial

On Spectral Characterization of Two Classes of Unicycle Graphs

Low rank approximation with sparse integration of multiple manifolds for data representation

Spectral embedding and the latent geometry of multipartite networks

Using Laplacian Spectrum as Graph Feature Representation

Ensemble Manifold Structured Low Rank Approximation for Data Representation

Disentangling the Spectral Properties of the Hodge Laplacian: Not All Small Eigenvalues Are Equal

Spectral Convergence Rate of Graph Laplacian

Revealing Smooth Structure of Visual Data by Permutation on Manifolds.

A Graph Framework for Manifold-valued Data

MS-IMAP -- A Multi-Scale Graph Embedding Approach for Interpretable Manifold Learning

Spectral Flow on the Manifold of SPD Matrices for Multimodal Data Processing

On a Hierarchy of Spectral Invariants for Graphs

SAGMAN: Stability Analysis of Graph Neural Networks on the Manifolds

A New Family of Graph Representation Matrices: Application to Graph and Signal Classification

Persistent spectral graph

Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications