Abstract:Understanding the underlying component structure is crucial for multivariate signal analysis. Among all the techniques that try to learn the latent structure, independent component analysis (ICA) is one of the most important and popular methods, which aims to extract independent components from multivariate signals and enables further analysis. For example, in electroencephalogram (EEG) analysis, artifacts filtering and disease detection are conducted based on the independent components of the signals. One critical challenge in existing ICA approaches is that the component extraction accuracy may degrade when the available data of a unit are limited. To address this issue, this paper proposes a transfer learning-based ICA method by innovatively transferring component distribution from a source domain, so that accurate component extraction results can be achieved even when only limited data are available in the target domain. To the best of our knowledge, this is the first work that leverages transfer learning to improve ICA accuracy with limited available data. In particular, we first extract all the independent components from the source domain by maximizing the log-likelihood function with a Newton-like method on a smooth manifold. Then for the target domain, the component with the largest negentropy is extracted in each round. To effectively leverage the knowledge from the source domain and to prevent the negative transfer, we try to find a component in the source domain that matches the component we are extracting. The probability density function of the matched component will then be used to improve the component extraction accuracy if such matched component can be found; otherwise, no knowledge will be transferred. Numerical simulations and a case study with electrocardiogram (ECG) data are conducted, showing the effectiveness of the proposed method in transferring knowledge and reducing negative transfer. Note to Practitioners—This paper is motivated by the practical issue of conducting independent component analysis when data are limited to derive a reliable result. To address this challenge, we propose to transfer knowledge from a source domain to the target domain. Specifically, there are two fundamental questions involved: 1) what knowledge can be transferred from the source domain; and 2) how to minimize the negative transfer when no useful knowledge is available. Our novel idea is to transfer the component distributions and the negative transfer is largely reduced through a component matching step as a result. There are four main steps involved when implementing the proposed method: 1) solve all the independent components in the source domain; 2) extract the independent component in the target domain with the largest negentropy; 3) decide whether a matched component can be found from the source domain; and 4) re-estimate the current independent component in the target domain by leveraging the distribution information of the matched component. Step 2 to step 4 are repeated several times until all the independent components in the target domain are extracted or some termination condition is reached.

Matching Component Analysis for Transfer Learning

Multi-component transfer metric learning for handling unrelated source domain samples

Transfer Sparse Machine: Matching Joint Distribution By Subspace Learning And Classifier Transduction

Partial Gromov-Wasserstein Learning for Partial Graph Matching

Transfer Learning-Based Independent Component Analysis

Deep Coupled Metric Learning for Cross-Modal Matching.

Fit Like You Sample: Sample-Efficient Generalized Score Matching from Fast Mixing Diffusions

Domain Adaptation via Transfer Component Analysis

A Parallel and Efficient Algorithm for Learning to Match.

Language Recognition Based on Unsupervised Transfer Component Analysis

Mutual Component Analysis for Heterogeneous Face Recognition.

Progressive correspondence learning by effective multi-channel aggregation

Learning to Characterize Matching Experts

ComMatch: A semi-supervised learning classification algorithm based on model calibration

Interpretation and Generalization of Score Matching

Matched Machine Learning: A Generalized Framework for Treatment Effect Inference With Learned Metrics

MALTS: Matching After Learning to Stretch

Identifiable Shared Component Analysis of Unpaired Multimodal Mixtures

Learning From Noisy Correspondence With Tri-Partition for Cross-Modal Matching

Seeing By Touching: Cross-Modal Matching For Tactile And Vision Measurements

Model Matching: A Novel Framework to Use Clustering Strategy to Solve the Classification Problem.