Abstract:Correspondence analysis, multiple correspondence analysis and their discriminant counterparts (i.e., discriminant simple correspondence analysis and discriminant multiple correspondence analysis) are methods of choice for analyzing multivariate categorical data. In these methods, variables are integrated into optimal components computed as linear combinations whose weights are obtained from a generalized singular value decomposition (GSVD) that integrates specific metric constraints on the rows and columns of the original data matrix. The weights of the linear combinations are, in turn, used to interpret the components, and this interpretation is facilitated when components are 1) pairwise orthogonal and 2) when the values of the weights are either large or small but not intermediate-a pattern called a simple or a sparse structure. To obtain such simple configurations, the optimization problem solved by the GSVD is extended to include new constraints that implement component orthogonality and sparse weights. Because multiple correspondence analysis represents qualitative variables by a set of binary variables, an additional group constraint is added to the optimization problem in order to sparsify the whole set representing one qualitative variable. This new algorithm-called group-sparse GSVD (gsGSVD)-integrates these constraints via an iterative projection scheme onto the intersection of subspaces where each subspace implements a specific constraint. In this paper, we expose this new algorithm and show how it can be adapted to the sparsification of simple and multiple correspondence analysis, and illustrate its applications with the analysis of four different data sets-each illustrating the sparsification of a particular CA-based analysis.

A two-step basis vector extraction strategy for multiset variable correlation analysis

Multi-View Correlated Feature Learning by Uncovering Shared Component.

Detecting and Visualizing Profile Correlation in Subspace

Two-step Multiset Regression Analysis (msra) Algorithm

Biclusters Based Visual Exploration of Multivariate Scientific Data

A New Algorithm for Eliminating the Correlation among Multi-Sources

Sparse 2-D Canonical Correlation Analysis Via Low Rank Matrix Approximation for Feature Extraction.

Correlated Components Analysis - Extracting Reliable Dimensions in Multivariate Data

A Co-analysis Framework for Exploring Multivariate Scientific Data

Exploiting Correlation Consensus: Towards Subspace Clustering For Multi-Modal Data

Detection of Correlated Components in Multivariate Gaussian Models

A Survey on Canonical Correlation Analysis

Soft Subspace Based Ensemble Clustering for Multivariate Time Series Data.

Sparse Factor Analysis for Categorical Data with the Group-Sparse Generalized Singular Value Decomposition

Robust Multi-subspace Analysis Using Novel Column L0-norm Constrained Matrix Factorization

Sparse canonical correlation analysis for recognition

Sparse Vector Autoregressive Modeling

A Two-Stage Variable Selection Approach for Correlated High Dimensional Predictors

Multivariate Linear Correlation Analysis

Exploring Shared Subspace and Joint Sparsity for Canonical Correlation Analysis.

Identifying correlated components in high-dimensional multivariate gaussian models