Abstract:Sparse principal component analysis (sPCA) enhances the interpretability of principal components (PCs) by imposing sparsity constraints on loading vectors (LVs). However, when used as a precursor to independent component analysis (ICA) for blind source separation (BSS), sPCA may underperform due to its focus on simplicity, potentially disregarding some statistical information essential for effective ICA. To overcome this limitation, a sophisticated approach is proposed that preserves the interpretability advantages of sPCA while significantly enhancing its source extraction capabilities. This consists of two tailored algorithms, dissociative PCA (DPCA1 and DPCA2), which employ adaptive and firm thresholding alongside gradient and coordinate descent approaches to optimize the proposed model dynamically. These algorithms integrate left and right singular vectors from singular value decomposition (SVD) through dissociation matrices (DMs) that replace traditional singular values, thus capturing latent interdependencies effectively to model complex source relationships. This leads to refined PCs and LVs that more accurately represent the underlying data structure. The proposed approach avoids focusing on individual eigenvectors, instead, it collaboratively combines multiple eigenvectors to disentangle interdependencies within each SVD variate. The superior performance of the proposed DPCA algorithms is demonstrated across four varied imaging applications including functional magnetic resonance imaging (fMRI) source retrieval, foreground-background separation, image reconstruction, and image inpainting. They outperformed traditional methods such as PCA+ICA, PPCA+ICA, SPCA+ICA, PMD, and GPower.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is how to enhance the interpretability of data and the source extraction ability in Blind Source Separation (BSS) by improving Sparse Principal Component Analysis (sPCA). Specifically: 1. **Limitations of existing methods**: - Although traditional sPCA improves the interpretability of Principal Components (PCs) by imposing sparse constraints, it may overlook some statistical information crucial for effective Independent Component Analysis (ICA) when used as a pre - processing step for ICA. - Traditional PCA lacks interpretability and may not be able to effectively separate sources when performing subsequent ICA, especially in the case of significant spatial overlap. 2. **Proposed new methods**: - The paper proposes two new algorithms: Dissociative PCA (DPCA1 and DPCA2). These algorithms combine adaptive and fixed thresholds as well as gradient and coordinate descent methods to dynamically optimize the model. - DPCA captures potential interdependencies by introducing Dissociation Matrices (DMs) instead of traditional singular values, thus representing the underlying data structure more accurately. 3. **Objectives**: - The proposed method aims not only to improve the interpretability of PCs but also to significantly enhance the source extraction ability, especially in the case of significant spatial overlap. - By synergistically combining multiple eigenvectors instead of focusing on a single eigenvector, DPCA can more effectively unravel the interdependencies within SVD variables. 4. **Application scenarios**: - The research demonstrates the superior performance of the DPCA algorithm in four different imaging applications, including functional magnetic resonance imaging (fMRI) source retrieval, foreground - background separation, image reconstruction, and image inpainting. 5. **Innovative points**: - Model the interdependencies between PCs and LVs to capture spatio - temporal realities. - Introduce two novel algorithms that integrate adaptive thresholds with gradient and coordinate descent techniques, simplifying the solution process of the optimization model. - Implement a quadratic fixed threshold to maintain sparsity and effectively remove background noise in the modified LVs, thereby improving interpretability and separation effects simultaneously. In summary, this paper aims to develop a new method (DPCA) by improving sPCA to overcome the limitations of existing methods in blind source separation, especially when dealing with complex data structures and significant spatial overlap.

Enhancing Blind Source Separation with Dissociative Principal Component Analysis

Sparse Principal Component Analysis With Preserved Sparsity Pattern

Disentangling Interpretable Factors with Supervised Independent Subspace Principal Component Analysis

Analysis of fMRI data based on sparsity of source components in signal dictionary.

Blind source separation based on affine projection and independent component analysis

Sparse principal component analysis via regularized low rank matrix approximation

Sparsity and adaptivity for the blind separation of partially correlated sources

[Blind source separation for fMRI signals using a new independent component analysis algorithm and principal component analysis]

Principal component analysis and blind separation of sources for optical imaging of intrinsic signals

A Nonlinear Pca Algorithm Using Qr Decomposition

Parallel Blind Source Separation by Kurtosis Maximization with Successive Prewhitening

A Particle Swarm Optimised Independence Estimator for Blind Source Separation of Neurophysiological Time Series

Improved FastICA Algorithm in Fmri Data Analysis Using the Sparsity Property of the Sources

Unraveling Mixtures: A Novel Underdetermined Blind Source Separation Approach via Sparse Component Analysis

A Selective Overview of Sparse Principal Component Analysis

Blind Source Separation Based on Compressed Sensing

Application and Extension of PCA Concepts to Blind Unmixing of Hyperspectral Data with Intra-class Variability

Including Signal Intensity Increases the Performance of Blind Source Separation on Brain Imaging Data

Oblique projectors-based blind source separation using information maximization principle

Estimating Sparse Sources from Data Mixtures using Maxima in Phase Space Plots