Abstract:Independent Vector Analysis (IVA) has emerged in recent years as an extension of Independent Component Analysis (ICA) into multiple sets of mixtures, where the source signals in each set are independent, but may depend on source signals in the other sets. In a semi-blind IVA (or ICA) framework, information regarding the probability distributions of the sources may be available, giving rise to Maximum Likelihood (ML) separation. In recent work we have shown that under the multivariate Gaussian model, with arbitrary temporal covariance matrices (stationary or non-stationary) of the source signals, ML separation requires the solution of a "Sequentially Drilled" Joint Congruence (SeDJoCo) transformation of a set of matrices, which is reminiscent of (but different from) classical joint diagonalization. In this paper we extend our results to the IVA problem, showing how the ML solution for the Gaussian model (with arbitrary covariance and cross-covariance matrices) takes the form of an extended SeDJoCo problem. We formulate the extended problem, derive a condition for the existence of a solution, and propose two iterative solution algorithms. In addition, we derive the induced Cramér-Rao Lower Bound (iCRLB) on the resulting Interference-to-Source Ratios (ISR) matrices, and demonstrate by simulation how the ML separation obtained by solving the extended SeDJoCo problem indeed attains the iCRLB (asymptotically), as opposed to other separation approaches, which cannot exploit prior knowledge regarding the sources' distributions.

Independent Component Analysis Over Galois Fields

Identifiability of overcomplete independent component analysis

Beyond Comon’s Identifiability Theorem for Independent Component Analysis

Overcomplete ICA with a Geometric Algorithm

To Infinity and Beyond: on ICA over Hilbert Spaces

Overcomplete BSS with a Geometric Algorithm

Geometric Overcomplete ICA

Cumulant Tensors in Partitioned Independent Component Analysis

Bridging a Gap in Independent Component Analysis

On the Identifiability of Sparse ICA without Assuming Non-Gaussianity

Separation of Two Independent Sources by the Information-Theoretic Approach with Cubic Nonlinearity.

The Extended "Sequentially Drilled" Joint Congruence Transformation and its Application in Gaussian Independent Vector Analysis

On Model Identifiability in Analytic Postnonlinear ICA

Independent Component Analysis via Distance Covariance

Connecting geometric independent component analysis to unsupervised learning algorithms

Generalizing Nonlinear ICA Beyond Structural Sparsity

Uniqueness of linear independent component analysis and the Skitovitch-Darmois theorem

Fast and robust fixed-point algorithms for independent component analysis

Spurious Solution of the Maximum Likelihood Approach to Ica

Statistical Analysis Of Sample-Size Effects In Ica

A novel genetic algorithm based independent component analysis algorithm