Abstract:Correspondence analysis, multiple correspondence analysis and their discriminant counterparts (i.e., discriminant simple correspondence analysis and discriminant multiple correspondence analysis) are methods of choice for analyzing multivariate categorical data. In these methods, variables are integrated into optimal components computed as linear combinations whose weights are obtained from a generalized singular value decomposition (GSVD) that integrates specific metric constraints on the rows and columns of the original data matrix. The weights of the linear combinations are, in turn, used to interpret the components, and this interpretation is facilitated when components are 1) pairwise orthogonal and 2) when the values of the weights are either large or small but not intermediate-a pattern called a simple or a sparse structure. To obtain such simple configurations, the optimization problem solved by the GSVD is extended to include new constraints that implement component orthogonality and sparse weights. Because multiple correspondence analysis represents qualitative variables by a set of binary variables, an additional group constraint is added to the optimization problem in order to sparsify the whole set representing one qualitative variable. This new algorithm-called group-sparse GSVD (gsGSVD)-integrates these constraints via an iterative projection scheme onto the intersection of subspaces where each subspace implements a specific constraint. In this paper, we expose this new algorithm and show how it can be adapted to the sparsification of simple and multiple correspondence analysis, and illustrate its applications with the analysis of four different data sets-each illustrating the sparsification of a particular CA-based analysis.

Algebraic Sparse Factor Analysis

Sparse Bayesian factor analysis when the number of factors is unknown

Sparse factor models of high dimension

Sparse matrix methods for unbalanced multifactor analysis of variance and covariance

Low-Rank Approximations with Sparse Factors I: Basic Algorithms and Error Analysis

Sparse additive function decompositions facing basis transforms

Dynamic Sparse Factor Analysis

Sparse Asymptotic PCA: Identifying Sparse Latent Factors Across Time Horizon

Fast Bayesian Factor Analysis via Automatic Rotations to Sparsity

Factoring sparse polynomials fast

Interpretable Sparse Proximate Factors for Large Dimensions

Optimization Algorithms for Sparse Representations and Applications

Algebraic approach to maximum likelihood factor analysis

Computational Approaches for Exponential-Family Factor Analysis

Sparse Factor Analysis for Categorical Data with the Group-Sparse Generalized Singular Value Decomposition

Factorization algebra

Factor models and variable selection in high-dimensional regression analysis

Accelerated Structured Matrix Factorization

Algorithms for Approximate Subtropical Matrix Factorization

Dimensions of Higher Order Factor Analysis Models

A Comparison of Bayesian Inference Techniques for Sparse Factor Analysis