Abstract:Understanding the underlying component structure is crucial for multivariate signal analysis. Among all the techniques that try to learn the latent structure, independent component analysis (ICA) is one of the most important and popular methods, which aims to extract independent components from multivariate signals and enables further analysis. For example, in electroencephalogram (EEG) analysis, artifacts filtering and disease detection are conducted based on the independent components of the signals. One critical challenge in existing ICA approaches is that the component extraction accuracy may degrade when the available data of a unit are limited. To address this issue, this paper proposes a transfer learning-based ICA method by innovatively transferring component distribution from a source domain, so that accurate component extraction results can be achieved even when only limited data are available in the target domain. To the best of our knowledge, this is the first work that leverages transfer learning to improve ICA accuracy with limited available data. In particular, we first extract all the independent components from the source domain by maximizing the log-likelihood function with a Newton-like method on a smooth manifold. Then for the target domain, the component with the largest negentropy is extracted in each round. To effectively leverage the knowledge from the source domain and to prevent the negative transfer, we try to find a component in the source domain that matches the component we are extracting. The probability density function of the matched component will then be used to improve the component extraction accuracy if such matched component can be found; otherwise, no knowledge will be transferred. Numerical simulations and a case study with electrocardiogram (ECG) data are conducted, showing the effectiveness of the proposed method in transferring knowledge and reducing negative transfer. Note to Practitioners—This paper is motivated by the practical issue of conducting independent component analysis when data are limited to derive a reliable result. To address this challenge, we propose to transfer knowledge from a source domain to the target domain. Specifically, there are two fundamental questions involved: 1) what knowledge can be transferred from the source domain; and 2) how to minimize the negative transfer when no useful knowledge is available. Our novel idea is to transfer the component distributions and the negative transfer is largely reduced through a component matching step as a result. There are four main steps involved when implementing the proposed method: 1) solve all the independent components in the source domain; 2) extract the independent component in the target domain with the largest negentropy; 3) decide whether a matched component can be found from the source domain; and 4) re-estimate the current independent component in the target domain by leveraging the distribution information of the matched component. Step 2 to step 4 are repeated several times until all the independent components in the target domain are extracted or some termination condition is reached.

Knowledge Transfer across Multiple Principal Component Analysis Studies

Multi-View Correlated Feature Learning by Uncovering Shared Component.

Enhanced Knowledge Transfer for Collaborative Filtering with Multi-Source Heterogeneous Feedbacks

Crowdsourcing with Multiple-Source Knowledge Transfer

Transfer Kernel Learning for Multi-Source Transfer Gaussian Process Regression

Transfer Learning-Based Independent Component Analysis

Transfer Learning Via Multi-View Principal Component Analysis

Human-centric Transfer Learning Explanation Via Knowledge Graph [extended Abstract]

Minimax Optimal Transfer Learning for Kernel-based Nonparametric Regression

Representational Transfer Learning for Matrix Completion

Knowledge Transfer on Hybrid Graph

One-Class multiple instance learning via robust PCA for common object discovery

Analysis of Knowledge Transfer in Kernel Regime

Sparse Data-Dependent Kernel Principal Component Analysis Based on Least Squares Support Vector Machine for Feature Extraction and Recognition.

Multiple source partial knowledge transfer for manufacturing system modelling

A Framework of Sparse Kernel Principal Component Analysis and Its Applications

Graph Enabled Cross-Domain Knowledge Transfer

Gaussian Process-Based Transfer Kernel Learning for Unsupervised Domain Adaptation

Feature Selection via Transferring Knowledge Across Different Classes

Selective Knowledge Transfer for Cross-Domain Collaborative Recommendation

Learning the Shared Subspace for Multi-task Clustering and Transductive Transfer Classification.