Abstract:The distribution difference among multiple domains has been exploited for cross-domain text categorization in recent years. Along this line, we show two new observations in this study. First, the data distribution difference is often due to the fact that different domains use different index words to express the same concept. Second, the association between the conceptual feature and the document class can be stable across domains. These two observations actually indicate the distinction and commonality across domains. Inspired by the above observations, we propose a generative statistical model, named Collaborative Dual-PLSA (CD-PLSA), to simultaneously capture both the domain distinction and commonality among multiple domains. Different from Probabilistic Latent Semantic Analysis (PLSA) with only one latent variable, the proposed model has two latent factors y and z, corresponding to word concept and document class, respectively. The shared commonality intertwines with the distinctions over multiple domains, and is also used as the bridge for knowledge transformation. An Expectation Maximization (EM) algorithm is developed to solve the CD-PLSA model, and further its distributed version is exploited to avoid uploading all the raw data to a centralized location and help to mitigate privacy concerns. After the training phase with all the data from multiple domains we propose to refine the immediate outputs using only the corresponding local data. In summary, we propose a two-phase method for cross-domain text classification, the first phase for collaborative training with all the data, and the second step for local refinement. Finally, we conduct extensive experiments over hundreds of classification tasks with multiple source domains and multiple target domains to validate the superiority of the proposed method over existing state-of-the-art methods of supervised and transfer learning. It is noted to mention that as shown by the experimental results CD-PLSA for the collaborative training is more tolerant of distribution differences, and the local refinement also gains significant improvement in terms of classification accuracy.

Concept Learning for Cross-Domain Text Classification: A General Probabilistic Framework.

Knowledge-based Document Embedding for Cross-Domain Text Classification

Erratum to "mining Distinction and Commonality Across Multiple Domains Using Generative Model for Text Classification"

Cross-Domain Learning from Multiple Sources: A Consensus Regularization Perspective

Collaborative Dual-PLSA: Mining Distinction and Commonality Across Multiple Domains for Text Classification.

Learning Concepts from Large-Scale Data Sets by Pairwise Coupling with Probabilistic Outputs

Cross-Domain Labeled LDA for Cross-Domain Text Classification

Topic-bridged PLSA for Cross-Domain Text Classification

A Partially Supervised Cross-Collection Topic Model for Cross-Domain Text Classification.

Effectively Constructing Reliable Data for Cross-Domain Text Classification.

Topic Correlation Analysis for Cross-Domain Text Classification

Triplex Transfer Learning: Exploiting Both Shared and Distinct Concepts for Text Classification

Cross-Domain Collaborative Learning Via Discriminative Nonparametric Bayesian Model

Exploiting Associations Between Word Clusters and Document Classes for Cross-domain Text Categorization

Learning Semantic Topics for Domain-Adapted Textual Knowledge Transfer

Cross-Domain Sentiment Classification with In-Domain Contrastive Learning

Cross-domain Named Entity Recognition via Graph Matching

Cross-Domain Collaborative Learning in Social Multimedia

Chinese Terminology Extraction Using EM-Based Transfer Learning Method.

Fuzzy-Based Concept Learning Method: Exploiting Data With Fuzzy Conceptual Clustering

Iterative Reinforcement Cross-Domain Text Classification