Transfer learning via multi-view principal component analysis

JiYang-Sheng,ChenJia-Jun,NiuGang,ShangLin,DaiXin-Yu

DOI: https://doi.org/10.5555/1991836.1991845

IF: 1.871

2011-01-01

Journal of Computer Science and Technology

Abstract:Transfer learning aims at leveraging the knowledge in labeled source domains to predict the unlabeled data in a target domain, where the distributions are different in domains. Among various method...

What problem does this paper attempt to address?

Transfer Learning Via Multi-View Principal Component Analysis

Yang-Sheng Ji,Jia-Jun Chen,Gang Niu,Lin Shang,Xin-Yu Dai

DOI: https://doi.org/10.1007/s11390-011-9417-6

2011-01-01

Abstract:Transfer learning aims at leveraging the knowledge in labeled source domains to predict the unlabeled data in a target domain, where the distributions are different in domains. Among various methods for transfer learning, one kind of algorithms focus on the correspondence between bridge features and all the other specific features from different domains, and later conduct transfer learning via the single-view correspondence. However, the single-view correspondence may prevent these algorithms from further improvement due to the problem of incorrect correlation discovery. To tackle this problem, we propose a new method for transfer learning in a multi-view correspondence perspective, which is called Multi-View Principal Component Analysis (MVPCA) approach. MVPCA discovers the correspondence between bridge features representative across all domains and specific features from different domains respectively, and conducts the transfer learning by dimensionality reduction in a multi-view way, which can better depict the knowledge transfer. Experiments show that MVPCA can significantly reduce the cross domain prediction error of a baseline non-transfer method. With multiview correspondence information incorporated to the single-view transfer learning method, MVPCA can further improve the performance of one state-of-the-art single-view method.
Multi-View Correlated Feature Learning by Uncovering Shared Component.

Xiaowei Xue,Feiping Nie,Sen Wang,Xiaojun Chang,Bela Stantic,Min Yao

DOI: https://doi.org/10.1609/aaai.v31i1.10823

2017-01-01

Abstract:Learning multiple heterogeneous features from different data sources is challenging. One research topic is how to exploit and utilize the correlations among various features across multiple views with the aim of improving the performance of learning tasks, such as classification. In this paper, we propose a new multi-view feature learning algorithm that simultaneously analyzes features from different views. Compared to most of the existing subspace learning methods that only focus on exploiting a shared latent subspace, our algorithm not only learns individual information in each view but also captures feature correlations among multiple views by learning a shared component. By assuming that such a component is shared by all views, we simultaneously exploit the shared component and individual information of each view in a batch mode. Since the objective function is non-smooth and difficult to solve, we propose an efficient iterative algorithm for optimization with guaranteed convergence. Extensive experiments are conducted on several benchmark datasets. The results demonstrate that our proposed algorithm performs better than all the compared multi-view learning algorithms.
Multi-View Analysis Dictionary Learning for Image Classification.

Qianyu Wang,Yanqing Guo,Jiujun Wang,Xiangyang Luo,Xiangwei Kong

DOI: https://doi.org/10.1109/access.2018.2791578

IF: 3.9

2018-01-01

IEEE Access

Abstract:A great number of studies show that considering information from multiple views results in better performance than their single-view counterparts. However, many previous works aiming to improve classification performance fail to effectively tackle the inter-view correlation or the intra-class variability. Analysis dictionary learning (ADL) has theoretic significance and practical potential in classification tasks. Based on the ADL, this paper proposes a new method, namely, multi-view analysis dictionary learning (MvADL) for image classification. Specifically, multi-view analysis dictionaries are designed to reduce the intra-class variability in the transformed space in the multi-view scenario. Then, a marginalized classification term is incorporated to integrate the semantic information into the basic dictionary learning model. In the marginalized classification term, a marginalized target learning strategy is applied to improve the flexibility and discriminability of the whole model. Besides, an iteratively optimizing algorithm is designed to solve the proposed MvADL. Experiments on benchmark data sets demonstrate the superiority of our proposed method.
Coupling loss and self-used privileged information guided multi-view transfer learning

Jingjing Tang,Yiwei He,Yingjie Tian,Dalian Liu,Gang Kou,Fawaz E. Alsaadi

DOI: https://doi.org/10.1016/j.ins.2020.11.007

IF: 8.1

2021-04-01

Information Sciences

Abstract:<p>Transfer learning builds models for the target domain by leveraging the information from another related source domain, in which the distributions of two domains are usually quite distinct. Real-world data are often characterized by multiple representations known as multi-view features. In the multi-view transfer learning field, existing methods aim to address the following two issues. Firstly, due to the distributional difference between the two domains, the classifier trained on the source domain may underperform on the target domain. Moreover, the lack of data from the target domain generally occurs in the training phase. Secondly, how to fully exploit the relations among multiple features is challenging when such multi-view representations emerge in the source and target domains. In this paper, we propose a new coupling loss and self-used privileged information guided multi-view transfer learning method (MVTL-CP). The first issue is addressed by utilizing the weighted labeled data from the source domain to learn a precise classifier for the target domain. Following the consensus and complementarity principles, we tackle the second issue by making the best use of multiple views. Furthermore, we analyze the consistency between views and the generalization capability of MVTL-CP. Comprehensive experiments confirm the effectiveness of our proposed model.</p>

computer science, information systems
Multi-component transfer metric learning for handling unrelated source domain samples

Chang’an Yi,Yonghui Xu,Han Yu,Yuguang Yan,Yang Liu

DOI: https://doi.org/10.1016/j.knosys.2020.106132

2020-09-01

Abstract:<p>Transfer learning (TL) is a machine learning paradigm designed for the problem where the training and test data are from different domains. Existing TL approaches mostly assume that training data from the source domain are collected from multiple views or devices. However, in practical applications, a sample in a target domain often only corresponds to a specific view or device. Without the ability to mitigate the influence of the many unrelated samples, the performance of existing TL approaches may deteriorate for such learning tasks. This problem will be exacerbated if the intrinsic relationships among the source domain samples are unclear. Currently, there is no mechanism for determining the intrinsic characteristics of samples in order to treat them differently during TL. The source domain samples that are not related to the test data not only incur computational overhead, but may result in negative transfer. We propose the multi-component transfer metric learning (MCTML) method to address this challenging research problem. Unlike previous metric-based transfer learning which are only capable of using one metric to transform all the samples, MCTML automatically extracts distinct components from the source domain and learns one metric for each component. For each component, MCTML learns the importance of that component in terms of its predictive power based on the Mahalanobis distance metrics. The optimized combination of components are then used to predict the test data collaboratively. Extensive experiments on public datasets demonstrates its effectiveness in knowledge transfer under this challenging condition.</p>

computer science, artificial intelligence
Knowledge Transfer across Multiple Principal Component Analysis Studies

Zeyu Li,Kangxiang Qin,Yong He,Wang Zhou,Xinsheng Zhang

2024-03-12

Abstract:Transfer learning has aroused great interest in the statistical community. In this article, we focus on knowledge transfer for unsupervised learning tasks in contrast to the supervised learning tasks in the literature. Given the transferable source populations, we propose a two-step transfer learning algorithm to extract useful information from multiple source principal component analysis (PCA) studies, thereby enhancing estimation accuracy for the target PCA task. In the first step, we integrate the shared subspace information across multiple studies by a proposed method named as Grassmannian barycenter, instead of directly performing PCA on the pooled dataset. The proposed Grassmannian barycenter method enjoys robustness and computational advantages in more general cases. Then the resulting estimator for the shared subspace from the first step is further utilized to estimate the target private subspace in the second step. Our theoretical analysis credits the gain of knowledge transfer between PCA studies to the enlarged eigenvalue gap, which is different from the existing supervised transfer learning tasks where sparsity plays the central role. In addition, we prove that the bilinear forms of the empirical spectral projectors have asymptotic normality under weaker eigenvalue gap conditions after knowledge transfer. When the set of informativesources is unknown, we endow our algorithm with the capability of useful dataset selection by solving a rectified optimization problem on the Grassmann manifold, which in turn leads to a computationally friendly rectified Grassmannian K-means procedure. In the end, extensive numerical simulation results and a real data case concerning activity recognition are reported to support our theoretical claims and to illustrate the empirical usefulness of the proposed transfer learning methods.

Machine Learning
Multiview Latent Space Learning with Progressively Fine-tuned Deep Features for Unsupervised Domain Adaptation

Chenyang Zhu,Qian Wang,Yunxin Xie,Shoukun Xu

DOI: https://doi.org/10.1016/j.ins.2024.120223

IF: 8.1

2024-02-02

Information Sciences

Abstract:Unsupervised Domain Adaptation (UDA) and Multi-source Domain Adaptation (MDA) have emerged as practical techniques to address the domain shift between source and target domains with different statistical distributions, where the target domain often has unlabeled samples. In recent years, end-to-end training approaches have been employed to learn domain-invariant representations, which enable customized adaptations simultaneously for UDA and MDA tasks. Although the conventional pseudo-labeling approach can leverage unlabelled target samples, the potential for inaccurate pseudo-labeling is counterproductive. This work proposes a multiview latent space learning framework with progressively fine-tuned deep features to improve UDA and MDA performance. Specifically, we construct three views, including features directly extracted from pre-trained deep learning models, fine-tuned features with source samples, and fine-tuned features with source samples and pseudo-labeled target samples, to enable unsupervised clustering analysis. More importantly, we utilize a multiview-based selective pseudo-labeling approach that selects the most confident labeled target samples with the maximum conditional probability. Through systematic experiential evaluations incorporating deep learning backbones such as ResNet-50 and DeiT-base, we demonstrate that our proposed multiview latent space learning method consistently outperforms state-of-the-art approaches on various UDA and MDA tasks.

computer science, information systems
A Survey on Multi-view Learning

Chang Xu,Dacheng Tao,Chao Xu

DOI: https://doi.org/10.48550/arxiv.1304.5634

2013-01-01

Abstract:In recent years, a great many methods of learning from multi-view data by considering the diversity of different views have been proposed. These views may be obtained from multiple sources or different feature subsets. In trying to organize and highlight similarities and differences between the variety of multi-view learning approaches, we review a number of representative multi-view learning algorithms in different areas and classify them into three groups: 1) co-training, 2) multiple kernel learning, and 3) subspace learning. Notably, co-training style algorithms train alternately to maximize the mutual agreement on two distinct views of the data; multiple kernel learning algorithms exploit kernels that naturally correspond to different views and combine kernels either linearly or non-linearly to improve learning performance; and subspace learning algorithms aim to obtain a latent subspace shared by multiple views by assuming that the input views are generated from this latent subspace. Though there is significant variance in the approaches to integrating multiple views to improve learning performance, they mainly exploit either the consensus principle or the complementary principle to ensure the success of multi-view learning. Since accessing multiple views is the fundament of multi-view learning, with the exception of study on learning a model from multiple views, it is also valuable to study how to construct multiple views and how to evaluate these views. Overall, by exploring the consistency and complementary properties of different views, multi-view learning is rendered more effective, more promising, and has better generalization ability than single-view learning.
Multi-view Common Component Discriminant Analysis for Cross-view Classification

Xinge You,Jiamiao Xu,Wei Yuan,Xiao-Yuan Jing,Dacheng Tao,Taiping Zhang

DOI: https://doi.org/10.48550/arXiv.1805.05029

2018-05-20

Abstract:Cross-view classification that means to classify samples from heterogeneous views is a significant yet challenging problem in computer vision. A promising approach to handle this problem is the multi-view subspace learning (MvSL), which intends to find a common subspace for multi-view data. Despite the satisfactory results achieved by existing methods, the performance of previous work will be dramatically degraded when multi-view data lies on nonlinear manifolds. To circumvent this drawback, we propose Multi-view Common Component Discriminant Analysis (MvCCDA) to handle view discrepancy, discriminability and nonlinearity in a joint manner. Specifically, our MvCCDA incorporates supervised information and local geometric information into the common component extraction process to learn a discriminant common subspace and to discover the nonlinear structure embedded in multi-view data. We develop a kernel method of MvCCDA to further boost the performance of MvCCDA. Beyond kernel extension, optimization and complexity analysis of MvCCDA are also presented for completeness. Our MvCCDA is competitive with the state-of-the-art MvSL based methods on four benchmark datasets, demonstrating its superiority.

Computer Vision and Pattern Recognition
Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware Transformers

Yong Xu,Xiaoling Luo,Jie Wen,Chengliang Liu

DOI: https://doi.org/10.48550/arXiv.2303.07180

2023-03-13

Abstract:As we all know, multi-view data is more expressive than single-view data and multi-label annotation enjoys richer supervision information than single-label, which makes multi-view multi-label learning widely applicable for various pattern recognition tasks. In this complex representation learning problem, three main challenges can be characterized as follows: i) How to learn consistent representations of samples across all views? ii) How to exploit and utilize category correlations of multi-label to guide inference? iii) How to avoid the negative impact resulting from the incompleteness of views or labels? To cope with these problems, we propose a general multi-view multi-label learning framework named label-guided masked view- and category-aware transformers in this paper. First, we design two transformer-style based modules for cross-view features aggregation and multi-label classification, respectively. The former aggregates information from different views in the process of extracting view-specific features, and the latter learns subcategory embedding to improve classification performance. Second, considering the imbalance of expressive power among views, an adaptively weighted view fusion module is proposed to obtain view-consistent embedding features. Third, we impose a label manifold constraint in sample-level representation learning to maximize the utilization of supervised information. Last but not least, all the modules are designed under the premise of incomplete views and labels, which makes our method adaptable to arbitrary multi-view and multi-label data. Extensive experiments on five datasets confirm that our method has clear advantages over other state-of-the-art methods.

Computer Science
Transfer Feature Learning with Joint Distribution Adaptation

Mingsheng Long,Jianmin Wang,Guiguang Ding,Jiaguang Sun,Philip S. Yu

DOI: https://doi.org/10.1109/iccv.2013.274

2013-01-01

Abstract:Transfer learning is established as an effective technology in computer vision for leveraging rich labeled data in the source domain to build an accurate classifier for the target domain. However, most prior methods have not simultaneously reduced the difference in both the marginal distribution and conditional distribution between domains. In this paper, we put forward a novel transfer learning approach, referred to as Joint Distribution Adaptation (JDA). Specifically, JDA aims to jointly adapt both the marginal distribution and conditional distribution in a principled dimensionality reduction procedure, and construct new feature representation that is effective and robust for substantial distribution difference. Extensive experiments verify that JDA can significantly outperform several state-of-the-art methods on four types of cross-domain image classification problems.
Deep Supervised Multi-View Learning with Graph Priors.

Peng Hu,Liangli Zhen,Xi Peng,Hongyuan Zhu,Jie Lin,Xu Wang,Dezhong Peng

DOI: https://doi.org/10.1109/tip.2023.3335825

IF: 10.6

2024-01-01

IEEE Transactions on Image Processing

Abstract:This paper presents a novel method for supervised multi-view representation learning, which projects multiple views into a latent common space while preserving the discrimination and intrinsic structure of each view. Specifically, an apriori discriminant similarity graph is first constructed based on labels and pairwise relationships of multi-view inputs. Then, view-specific networks progressively map inputs to common representations whose affinity approximates the constructed graph. To achieve graph consistency, discrimination, and cross-view invariance, the similarity graph is enforced to meet the following constraints: 1) pairwise relationship should be consistent between the input space and common space for each view; 2) within-class similarity is larger than any between-class similarity for each view; 3) the inter-view samples from the same (or different) classes are mutually similar (or dissimilar). Consequently, the intrinsic structure and discrimination are preserved in the latent common space using an apriori approximation schema. Moreover, we present a sampling strategy to approach a sub-graph sampled from the whole similarity structure instead of approximating the graph of the whole dataset explicitly, thus benefiting lower space complexity and the capability of handling large-scale multi-view datasets. Extensive experiments show the promising performance of our method on five datasets by comparing it with 18 state-of-the-art methods.
Domain Adaptation via Transfer Component Analysis

I. Tsang,Qiang Yang,J. Kwok,Sinno Jialin Pan

DOI: https://doi.org/10.1109/TNN.2010.2091281

2009-07-11

IEEE Transactions on Neural Networks

Abstract:Domain adaptation allows knowledge from a source domain to be transferred to a different but related target domain. Intuitively, discovering a good feature representation across domains is crucial. In this paper, we first propose to find such a representation through a new learning method, transfer component analysis (TCA), for domain adaptation. TCA tries to learn some transfer components across domains in a reproducing kernel Hilbert space using maximum mean miscrepancy. In the subspace spanned by these transfer components, data properties are preserved and data distributions in different domains are close to each other. As a result, with the new representations in this subspace, we can apply standard machine learning methods to train classifiers or regression models in the source domain for use in the target domain. Furthermore, in order to uncover the knowledge hidden in the relations between the data labels from the source and target domains, we extend TCA in a semisupervised learning setting, which encodes label information into transfer components learning. We call this extension semisupervised TCA. The main contribution of our work is that we propose a novel dimensionality reduction framework for reducing the distance between domains in a latent space for domain adaptation. We propose both unsupervised and semisupervised feature extraction approaches, which can dramatically reduce the distance between domain distributions by projecting data onto the learned transfer components. Finally, our approach can handle large datasets and naturally lead to out-of-sample generalization. The effectiveness and efficiency of our approach are verified by experiments on five toy datasets and two real-world applications: cross-domain indoor WiFi localization and cross-domain text classification.

Mathematics,Medicine,Computer Science
Multi-Source Deep Transfer Neural Network Algorithm

Jingmei Li,Weifei Wu,Di Xue,Peng Gao

DOI: https://doi.org/10.3390/s19183992

IF: 3.9

2019-09-16

Sensors

Abstract:Transfer learning can enhance classification performance of a target domain with insufficient training data by utilizing knowledge relating to the target domain from source domain. Nowadays, it is common to see two or more source domains available for knowledge transfer, which can improve performance of learning tasks in the target domain. However, the classification performance of the target domain decreases due to mismatching of probability distribution. Recent studies have shown that deep learning can build deep structures by extracting more effective features to resist the mismatching. In this paper, we propose a new multi-source deep transfer neural network algorithm, MultiDTNN, based on convolutional neural network and multi-source transfer learning. In MultiDTNN, joint probability distribution adaptation (JPDA) is used for reducing the mismatching between source and target domains to enhance features transferability of the source domain in deep neural networks. Then, the convolutional neural network is trained by utilizing the datasets of each source and target domain to obtain a set of classifiers. Finally, the designed selection strategy selects classifier with the smallest classification error on the target domain from the set to assemble the MultiDTNN framework. The effectiveness of the proposed MultiDTNN is verified by comparing it with other state-of-the-art deep transfer learning on three datasets.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Canonical Correlation Analysis (CCA) Based Multi-View Learning: An Overview

Chenfeng Guo,Dongrui Wu

DOI: https://doi.org/10.48550/arXiv.1907.01693

IF: 5.414

2019-07-03

Machine Learning

Abstract:Multi-view learning (MVL) is a strategy for fusing data from different sources or subsets. Canonical correlation analysis (CCA) is very important in MVL, whose main idea is to map data from different views onto a common space with maximum correlation. Traditional CCA can only be used to calculate the linear correlation of two views. Besides, it is unsupervised and the label information is wasted. Many nonlinear, supervised, or generalized extensions have been proposed to overcome these limitations. However, to our knowledge, there is no overview for these approaches. This paper provides an overview of many representative CCA-based MVL approaches.
Adaptive Transfer Learning of Multi-View Time Series Classification

Donglin Zhan,Shiyu Yi,Dongli Xu,Xiao Yu,Denglin Jiang,Siqi Yu,Haoting Zhang,Wenfang Shangguan,Weihua Zhang

DOI: https://doi.org/10.48550/arXiv.1910.07632

IF: 5.414

2019-10-14

Machine Learning

Abstract:Time Series Classification (TSC) has been an important and challenging task in data mining, especially on multivariate time series and multi-view time series data sets. Meanwhile, transfer learning has been widely applied in computer vision and natural language processing applications to improve deep neural network's generalization capabilities. However, very few previous works applied transfer learning framework to time series mining problems. Particularly, the technique of measuring similarities between source domain and target domain based on dynamic representation such as density estimation with importance sampling has never been combined with transfer learning framework. In this paper, we first proposed a general adaptive transfer learning framework for multi-view time series data, which shows strong ability in storing inter-view importance value in the process of knowledge transfer. Next, we represented inter-view importance through some time series similarity measurements and approximated the posterior distribution in latent space for the importance sampling via density estimation techniques. We then computed the matrix norm of sampled importance value, which controls the degree of knowledge transfer in pre-training process. We further evaluated our work, applied it to many other time series classification tasks, and observed that our architecture maintained desirable generalization ability. Finally, we concluded that our framework could be adapted with deep learning techniques to receive significant model performance improvements.
The Application of Target Embedding AutoEncoder based on Knowledge Distillation in Multi-View Multi-Label Classification

Xiaoyan Zou,Ying Zhong,Jianmin Li,Yanqi Xie,Huayi Yin,Ying Ma

DOI: https://doi.org/10.1109/ICCEA58433.2023.10135504

2023-01-01

Abstract:In multi-view learning, how to effectively integrate features among multiple views becomes a key challenge. For multi-label tasks, it is extremely important that the relationship between features and labels. This paper proposes a Target Embedding Autoencoder framework based on knowledge distillation (tea-mvml), which explores the correlation between features and labels in Multi-View Multi-Label (MVML) learning. The framework transfers knowledge from a teacher model based on a Target Embedding Autoencoder (TEA) to a small student model through knowledge distillation. The teacher model of tea-mvml learns the relationship between features and labels in the potential space, while the student model has the generalization ability of the teacher model. Experimental results on multiple real-world datasets show that tea-mvml not only reduces the complexity of the model, but also outperforms other state-of-the-art multi-view multi-label classification approaches.
Manifold Transfer Learning via Discriminant Regression Analysis

Yuwu Lu,Wenjing Wang,Chun Yuan,Xuelong Li,Zhihui Lai

DOI: https://doi.org/10.1109/TMM.2020.3007340

IF: 7.3

2021-01-01

IEEE Transactions on Multimedia

Abstract:In transfer learning, how to effectively transfer useful information from the source domain to the target domain is crucial. In this paper, we propose a novel transfer learning method for image classification, named manifold transfer learning via discriminant regression analysis (MTL-DRA), to transfer the local geometry structure information from the source domain to the target domain and ensure that the transform matrix is robust or sparse so that samples from different domains can be well combined. In MTL-DRA, we encode discriminant information of the source domain to the target domain by introducing between- and within-class graphs to preserve within-class similarity and reduce between-class similarity. With different norms as constraints, MTL-DRA overcomes the disturbance of noise and avoids negative transfer learning. To improve the robustness of MTL-DRA, we encode a nuclear norm constraint and propose robust MTL-DRA (RMTL-DRA). We analyzed the convergence and complexity of the two proposed methods. To verify the performance of the proposed methods, we conducted extensive experiments on five public image benchmarks. The experimental results show that the proposed methods outperform state-of-the-art transfer learning methods.
View Consistency based Co-training style MultiView Learning : A Privacy-Preserving Approach

MIAO Yuan,ZHAN De-chuan

2016-01-01

Abstract:Complex media objects are often described by multi-view feature groups collected from diverse domains or information channels. Multi-view learning, which attempts to exploit the relationship among multiple views to improve learning performance, has drawn extensive attention. It is noteworthy that in some real-world applications, features of different views may come from different private data repositories, and thus, it is desired to exploit view relationship with data privacy preserved simultaneously, i.e. not to share data features with other data repositories when training and testing the model. Existing multi-view learning approaches such as subspace methods and pre-fusion methods are not applicable in this scenario because they need to access the whole features, whereas late-fusion approaches could not exploit information from other views to improve the individual view-specific learners. Co-training methods can hardly deal with multiple views. Under the framework of co-training, by using view consistency defined on all the other view-specific classifiers’ predictions on new unlabeled examples to enlarge training set of one view, this paper proposed a novel privacy-preserving multi-view learning approach. Empirical investigations on real datasets verify the validity of the proposed method on various tasks.
A Multi-View Fusion Method Via Tensor Learning And Gradient Descent For Image Features

LaiHang Yu,DongYan Zhang,NingZhong Liu,WenGang Zhou

DOI: https://doi.org/10.1109/ACCESS.2021.3079499

IF: 3.9

2021-01-01

IEEE Access

Abstract:In many computer vision applications, one image can be represented by multiple heterogeneous features from different views, most of them commonly locate in high-dimensional space. These features can reflect different characteristics of one same object, they contain compatible and complementary information among each other. How to construct an uniform low-dimensional embedding features which represent useful information of multi-view features is still an important and urgent issue to be solved. Therefore, we propose a multi-view fusion method via tensor learning and gradient descent (MvF-TG) in this paper. MvF-TG reconstructs a lowdimensional mapping subspace of each object by utilizing its k nearest neighbors, which preserves the underlying neighborhood structure of the original local manifold. The new method can effectively exploit the spatial correlation information from the multi-view features by tensor learning. Furthermore, the method constructs a gradient descent optimization model to generate the better unified low dimensional embedding. The proposed method is compared with several single-view and multi-view dimensional reduction methods in these indicators of P, R, MAP and F-measure. In the retrieval experiments, the P values of the newmethod respectively are 86.80%, 52.00%, 68.56% and 78.80% on datasets of Corel1k, Corel5k, Corel10k and Holidays. In the classification experiments, the mean accuracies of it respectively are 47.94% and 87.58% on datasets of Caltech101 and Coil. These values are higher than those obtained by other comparison methods, various evaluations based on the applications of image classification and retrieval demonstrates the effectiveness of our proposed method on multi-view feature fusion dimension reduction.

Transfer learning via multi-view principal component analysis

Transfer Learning Via Multi-View Principal Component Analysis

Multi-View Correlated Feature Learning by Uncovering Shared Component.

Multi-View Analysis Dictionary Learning for Image Classification.

Coupling loss and self-used privileged information guided multi-view transfer learning

Multi-component transfer metric learning for handling unrelated source domain samples

Knowledge Transfer across Multiple Principal Component Analysis Studies

Multiview Latent Space Learning with Progressively Fine-tuned Deep Features for Unsupervised Domain Adaptation

A Survey on Multi-view Learning

Multi-view Common Component Discriminant Analysis for Cross-view Classification

Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware Transformers

Transfer Feature Learning with Joint Distribution Adaptation

Deep Supervised Multi-View Learning with Graph Priors.

Domain Adaptation via Transfer Component Analysis

Multi-Source Deep Transfer Neural Network Algorithm

Canonical Correlation Analysis (CCA) Based Multi-View Learning: An Overview

Adaptive Transfer Learning of Multi-View Time Series Classification

The Application of Target Embedding AutoEncoder based on Knowledge Distillation in Multi-View Multi-Label Classification

Manifold Transfer Learning via Discriminant Regression Analysis

View Consistency based Co-training style MultiView Learning : A Privacy-Preserving Approach

A Multi-View Fusion Method Via Tensor Learning And Gradient Descent For Image Features