Abstract:Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible without additional assumptions. Recent advances have proposed conditions on the connective structure from sources to observed variables, known as Structural Sparsity, to achieve identifiability in an unsupervised manner. However, the sparsity constraint may not hold universally for all sources in practice. Furthermore, the assumptions of bijectivity of the mixing process and independence among all sources, which arise from the setting of ICA, may also be violated in many real-world scenarios. To address these limitations and generalize nonlinear ICA, we propose a set of new identifiability results in the general settings of undercompleteness, partial sparsity and source dependence, and flexible grouping structures. Specifically, we prove identifiability when there are more observed variables than sources (undercomplete), and when certain sparsity and/or source independence assumptions are not met for some changing sources. Moreover, we show that even in cases with flexible grouping structures (e.g., part of the sources can be divided into irreducible independent groups with various sizes), appropriate identifiability results can also be established. Theoretical claims are supported empirically on both synthetic and real-world datasets.

Independent Subspace Analysis is Unique, Given Irreducibility

Hierarchical Extraction of Independent Subspaces of Unknown Dimensions

Uniqueness of Linear Factorizations into Independent Subspaces

Uniqueness of linear independent component analysis and the Skitovitch-Darmois theorem

Ica over Finite Fields-Separability and Algorithms

To Infinity and Beyond: on ICA over Hilbert Spaces

Uniqueness of complex and multidimensional independent component analysis

Unraveling the Veil of Subspace RIP Through Near-Isometry on Subspaces

Identifiability of overcomplete independent component analysis

Independent Component Analysis via Distance Covariance

On the Identifiability of Sparse ICA without Assuming Non-Gaussianity

Generalizing Nonlinear ICA Beyond Structural Sparsity

Multidimensional Independent Component Analysis Using Characteristic Functions

Second Order Subspace Analysis and Simple Decompositions

Independent Component Analysis Over Galois Fields

Uniqueness of non-gaussian subspace analysis

Block Jacobi-Type Methods for Log-Likelihood Based Linear Independent Subspace Analysis

Rigorous Restricted Isometry Property of Low-Dimensional Subspaces.

On Model Identifiability in Analytic Postnonlinear ICA

Independent Mechanism Analysis and the Manifold Hypothesis

Uniqueness of real and complex linear independent component analysis revisited