Abstract:Since the introduction of the lasso in regression, various sparse methods have been developed in an unsupervised context like sparse principal component analysis (s-PCA), sparse canonical correlation analysis (s-CCA) and sparse singular value decomposition (s-SVD). These sparse methods combine feature selection and dimension reduction. One advantage of s-PCA is to simplify the interpretation of the (pseudo) principal components since each one is expressed as a linear combination of a small number of variables. The disadvantages lie on the one hand in the difficulty of choosing the number of non-zero coefficients in the absence of a well established criterion and on the other hand in the loss of orthogonality for the components and/or the loadings. In this paper we propose sparse variants of correspondence analysis (CA)for large contingency tables like documents-terms matrices used in text mining, together with pPMD, a deation technique derived from projected deflation in s-PCA. We use the fact that CA is a double weighted PCA (for rows and columns) or a weighted SVD, as well as a canonical correlation analysis of indicator variables. Applying s-CCA or s-SVD allows to sparsify both rows and columns weights. The user may tune the level of sparsity of rows and columns and optimize it according to some criterium, and even decide that no sparsity is needed for rows (or columns) by relaxing one sparsity constraint. The latter is equivalent to apply s-PCA to matrices of row (or column) profiles.

ℓ0-Based Sparse Canonical Correlation Analysis with Application to Cross-Language Document Retrieval

Regularized Canonical Correlation Analysis with Unlabeled Data

Sparse Weighted Canonical Correlation Analysis

Sparse Canonical Correlation Analysis: New Formulation and Algorithm.

Sparse Generalized Canonical Correlation Analysis: Distributed Alternating Iteration Based Approach

On Sparse Canonical Correlation Analysis

Sparse Correspondence Analysis for Contingency Tables

Exploring Shared Subspace and Joint Sparsity for Canonical Correlation Analysis.

$\ell_0$-based Sparse Canonical Correlation Analysis

Tssnalm: A Fast Two-Stage Semi-Smooth Newton Augmented Lagrangian Method for Sparse CCA.

Sparse Kernel Canonical Correlation Analysis Via $\Ell_1$-Regularization

Eigenvector-based sparse canonical correlation analysis: Fast computation for estimation of multiple canonical vectors

Sparse canonical correlation analysis for recognition

An Inexact Manifold Augmented Lagrangian Method for Adaptive Sparse Canonical Correlation Analysis with Trace Lasso Regularization

Sufficient Canonical Correlation Analysis

Constrained ERM Learning of Canonical Correlation Analysis: A Least Squares Perspective

A Dynamic Discriminative Canonical Correlation Analysis via Adaptive Weight Scheme

Towards Improving Canonical Correlation Analysis for Cross-modal Retrieval.

A Local Method for Canonical Correlation Analysis.

Image Retrieval Approach Based on Sparse Canonical Correlation Analysis

Sparse Poisson coding for high dimensional document clustering