Abstract:Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible without additional assumptions. Recent advances have proposed conditions on the connective structure from sources to observed variables, known as Structural Sparsity, to achieve identifiability in an unsupervised manner. However, the sparsity constraint may not hold universally for all sources in practice. Furthermore, the assumptions of bijectivity of the mixing process and independence among all sources, which arise from the setting of ICA, may also be violated in many real-world scenarios. To address these limitations and generalize nonlinear ICA, we propose a set of new identifiability results in the general settings of undercompleteness, partial sparsity and source dependence, and flexible grouping structures. Specifically, we prove identifiability when there are more observed variables than sources (undercomplete), and when certain sparsity and/or source independence assumptions are not met for some changing sources. Moreover, we show that even in cases with flexible grouping structures (e.g., part of the sources can be divided into irreducible independent groups with various sizes), appropriate identifiability results can also be established. Theoretical claims are supported empirically on both synthetic and real-world datasets.

Study on the Indeterminacy of the Statistical Independence Based ICA Methods

Study on the Equivalence ICA Methods of the Based on the Statistical Independence

Random Variable Analogy Based ICA Method

A STATISTICAL APPROACH TO TESTING MUTUAL INDEPENDENCE OF ICA RECOVERED SOURCES

On the Identifiability of Sparse ICA without Assuming Non-Gaussianity

An efficient independent component analysis algorithm for sub-gaussian sources

Stochastic algorithms with descent guarantees for ICA

Linear and Nonlinear ICA Based on Mutual Information

Monotonic Convergence of a Nonnegative ICA Algorithm on Stiefel Manifold

The Study On The Principle Of Kurtosis Based Ica Method

Generalizing Nonlinear ICA Beyond Structural Sparsity

Analysis of the Kurtosis-Sum Objective Function for ICA

Identifiability of overcomplete independent component analysis

An Improved Natural Gradient Ica Algorithm Based On Lie Group Invariance

An ICA Algorithm Based on Symmetric and Asymmetric Generalized Gaussian Model

Independent Component Analysis via Distance Covariance

One-Bit-Matching Conjecture for Independent Component Analysis

On Model Identifiability in Analytic Postnonlinear ICA

A step by step optimization approach to independent component analysis

Random Variable Analogy Measurement Based ICA

Statistical Analysis Of Sample-Size Effects In Ica