Abstract:With the deepening of transfer learning research, researchers are no longer satisfied with the classification of knowledge in a single field but hope that the classification of knowledge in multiple fields can be realized, so as to simulate the behavior of human “analogy” and enable the machine to draw inferences”. However, the feature realization of multiple source domains often differs greatly, which brings a challenge to the traditional transfer learning scheme. In this paper, a multi-source deep transfer learning algorithm MDTLFA based on feature alignment is proposed to solve the problem that the data from multiple source domains often has different feature realizations. MDTLFA first reduces the difference in the marginal probability distribution between fields at the sample level by means of the maximum mean deviation MMD. Then, the feature alignment strategy is used at the feature level to further reduce the difference in the marginal probability distribution between the fields and maintain the unique data manifold structure while sharing similar features. On this basis, the conditional probability adaptation CPDA was constructed to reduce the difference in conditional probability distribution between domains and enhance the portability of source domain features. The CPTCNN model was constructed based on a convolutional neural network using CPDA. Finally, the CPTCNN model is trained in the subspace to obtain a classifier set, and the designed strategy is used to select the classifier with a small classification error in the target domain to form MDTLFA. Multiple source domains, marginal probability adaptation at the sample level and feature level, and the CPTCNN model constructed based on the minimization of conditional probability differences effectively improve the performance of data features in multiple domains, thus improving the classification effect. The experimental results on several real data sets show that the MDTLFA algorithm is effective and has some advantages compared with the advanced benchmark algorithm.

Multisource Deep Transfer Learning Based on Balanced Distribution Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

Multi-source deep transfer learning algorithm based on feature alignment

Multi-source unsupervised domain adaptation for object detection

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

Transfer Learning with Dynamic Distribution Adaptation

Multi-Source Deep Transfer Neural Network Algorithm

Deep Asymmetric Transfer Network For Unbalanced Domain Adaptation

Transfer Feature Learning with Joint Distribution Adaptation

Predictive Modeling With an Adaptive Unsupervised Broad Transfer Algorithm

Multi-source Distilling Domain Adaptation

More is Better: Deep Domain Adaptation with Multiple Sources

Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Survey

Enhancing classification performance through multi-source online transfer learning algorithm with oversampling

Multi-source Fully Test-Time Adaptation

DA-Net: A Disentangled and Adaptive Network for Multi-Source Cross-Lingual Transfer Learning

Bures Joint Distribution Alignment with Dynamic Margin for Unsupervised Domain Adaptation

Aligning Domain-Specific Distribution and Classifier for Cross-Domain Classification from Multiple Sources

Deep Transfer Network: Unsupervised Domain Adaptation

Reliable hybrid knowledge distillation for multi-source domain adaptive object detection