Abstract:Joint clustering and dimensionality reduction methods are a promising solution to clustering due to its scalability to high-dimensional data. Some methods leverage trace ratio criterion and attain clusters by borrowing the K-means algorithm. However, trace ratio criterion has no close-formed solution for the discriminative projection matrix and the K-means algorithm has a limited capacity to handle the many-cluster problem. In this paper, Coordinate Descent Optimized Trace Difference model (CDOTD) is proposed for joint clustering and feature extraction. Formulating the objective function as a direct trace difference criterion containing a balance parameter, CDOTD harmonizes between-cluster scatter maximization and within-cluster scatter minimization by the balance parameter. Using the direct trace difference criterion, CDOTD can straightforward solve for the discriminative projection matrix and avoid obtaining a poor discriminative projection matrix in the iterative manner when a bad cluster start is given. CDOTD uses the coordinate descent method for clustering optimization, improving the ability to address the many-cluster problem. Extensive experiments show that CDOTD has achieved significant performance improvements compared to previous trace ratio criterion related joint clustering and feature extraction methods, and also outperformed other clustering methods in most cases.

A variant of the trace quotient formulation for dimensionality reduction

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Supervised Dimensionality Reduction Via Sequential Semidefinite Programming

A Convex Programming Approach To The Trace Quotient Problem

Trace Ratio Problem Revisited

A Novel Formulation of Trace Ratio Linear Discriminant Analysis

A Unified Framework for Semi-Supervised Dimensionality Reduction

A Note on the Trace Quotient Problem.

Trace Ratio Optimization with an Application to Multi-view Learning

Transferred Dimensionality Reduction

Large-margin Weakly Supervised Dimensionality Reduction.

A new sufficient dimension reduction method via rank divergence

Feature Extraction Using Sequential Semidefinite Programming

Stable Local Dimensionality Reduction Approaches

On Minimum Trace Factor Analysis -- An Old Song Sung to a New Tune

Quantum Discriminant Analysis for Dimensionality Reduction and Classification

A New Reduced-Rank Linear Discriminant Analysis Method and Its Applications

Quantum Dimensionality Reduction by Linear Discriminant Analysis

Perturbation Analysis for the Trace Quotient Problem

Coordinate Descent Optimized Trace Difference Model for Joint Clustering and Feature Extraction

Semiparametric Efficient Dimension Reduction in multivariate regression with an Inner Envelope