Abstract:Correspondence analysis, multiple correspondence analysis and their discriminant counterparts (i.e., discriminant simple correspondence analysis and discriminant multiple correspondence analysis) are methods of choice for analyzing multivariate categorical data. In these methods, variables are integrated into optimal components computed as linear combinations whose weights are obtained from a generalized singular value decomposition (GSVD) that integrates specific metric constraints on the rows and columns of the original data matrix. The weights of the linear combinations are, in turn, used to interpret the components, and this interpretation is facilitated when components are 1) pairwise orthogonal and 2) when the values of the weights are either large or small but not intermediate-a pattern called a simple or a sparse structure. To obtain such simple configurations, the optimization problem solved by the GSVD is extended to include new constraints that implement component orthogonality and sparse weights. Because multiple correspondence analysis represents qualitative variables by a set of binary variables, an additional group constraint is added to the optimization problem in order to sparsify the whole set representing one qualitative variable. This new algorithm-called group-sparse GSVD (gsGSVD)-integrates these constraints via an iterative projection scheme onto the intersection of subspaces where each subspace implements a specific constraint. In this paper, we expose this new algorithm and show how it can be adapted to the sparsification of simple and multiple correspondence analysis, and illustrate its applications with the analysis of four different data sets-each illustrating the sparsification of a particular CA-based analysis.

Sparse matrix methods for unbalanced multifactor analysis of variance and covariance

The Contrast Algorithm for Unbalanced Multifactor Analysis of Variance

A note on extending Scheffé's modified multiple-comparison procedure to other analysis situations

A Comparison of Bayesian Inference Techniques for Sparse Factor Analysis

Sparse Correspondence Analysis for Contingency Tables

Algebraic Sparse Factor Analysis

Inferring Covariance Structure from Multiple Data Sources via Subspace Factor Analysis

Optimization Algorithms for Sparse Representations and Applications

Sparse estimation of a covariance matrix

Optimal Designs in Sparse Linear Models

Sparse factor models of high dimension

Structured Factor Analysis: A Data Matrix-Based Alternative Approach to Structural Equation Modeling

A New Algorithm for Computing Disjoint Orthogonal Components in the Parallel Factor Analysis Model with Simulations and Applications to Real-World Data

Sparse Factor Analysis for Categorical Data with the Group-Sparse Generalized Singular Value Decomposition

Sparse Component Analysis: A New Tool for Data Mining

Nonparametric estimation of large covariance matrices with conditional sparsity

Computer Programs for Robust Analyses in Multifactor Analysis of Variance Designs

Sparse Weighted Canonical Correlation Analysis

Using Exact Tests from Algebraic Statistics in Sparse Multi-Way Analyses: An Application to Analyzing Differential Item Functioning

A-ComVar: A Flexible Extension of Common Variance Design

High Dimensional Covariance Matrix Estimation Using Multi-Factor Models from Incomplete Information