Uniqueness of linear independent component analysis and the Skitovitch-Darmois theorem

Fabian J. Theis,Elmar W. Lang
2003-01-01
Abstract:Independent component analysis treats the problem of transforming a ran- dom vector in order to render it as independent as possible. In the case where the random vector is a mixture of independent sources, we speak of blind source separation (BSS). Linear BSS of as many sensors as sources has been shown to be most successful of all BSS cases. This is mostly due to the fact that this is one of the few cases where uniqueness results have been proved. Comon pointed out that BSS solutions are unique except for scaling and per- mutation of the sources; for this he reduced the problem to the Skitovitch- Darmois theorem. However, there is no compact proof of this central theorem easily available in the literature. In this paper, we will recall Comon's ideas and prove the Skitovitch-Darmois theorem in the case of rational coecients. This theorem provides a non-trivial connection between gaussian distribu- tions and stochastic independence. More precisely, it states that if two linear combinations of non-gaussian independent random variables are again inde- pendent, then each original random variable can appear only in one of the two linear combinations. Using this it is easy to proof the well-known uniqueness theorem of ICA.
What problem does this paper attempt to address?