Abstract:The goal of semi-supervised text classification (SSTC) is to train a model by exploring both a small number of labeled data and a large number of unlabeled data, such that the learned semi-supervised classifier performs better than the supervised classifier trained on solely the labeled samples. Pseudo-labeling is one of the most widely used SSTC techniques, which trains a teacher classifier with a small number of labeled examples to predict pseudo labels for the unlabeled data. The generated pseudo-labeled examples are then utilized to train a student classifier, such that the learned student classifier can outperform the teacher classifier. Nevertheless, the predicted pseudo labels may be inaccurate, making the performance of the student classifier degraded. The student classifier may perform even worse than the teacher classifier. To alleviate this issue, in this paper, we introduce a dual meta-learning ( DML ) technique for semi-supervised text classification, which improves the teacher and student classifiers simultaneously in an iterative manner. Specifically, we propose a meta-noise correction method to improve the student classifier by proposing a Noise Transition Matrix (NTM) with meta-learning to rectify the noisy pseudo labels. In addition, we devise a meta pseudo supervision method to improve the teacher classifier. Concretely, we exploit the feedback performance from the student classifier to further guide the teacher classifier to produce more accurate pseudo labels for the unlabeled data. In this way, both teacher and student classifiers can co-evolve in the iterative training process. Extensive experiments on four benchmark datasets highlight the effectiveness of our DML method against existing state-of-the-art methods for semi-supervised text classification. We release our code and data of this paper publicly at https://github.com/GRIT621/DML.

Minimum classification error rate training of supervised topic mixture model for multi-label text categorization

Label correlation mixture model for multi-label text categorization

Label Correlation Mixture Model: A Supervised Generative Approach to Multilabel Spoken Document Categorization

Multi-label Text Classification Based on the Label Correlation Mixture Model.

Muli-label Text Categorization with Hidden Components.

Partial Multi-label Learning with Label and Feature Collaboration

Multi-label Text Categorization with Joint Learning Predictions-as-Features Method

Weak Learning Algorithm For Multi-Label Multiclass Text Categorization

Text Categorization Based on Regularization Extreme Learning Machine

MixLab: An Informative Semi-supervised Method for Multi-label Classification

Multi-label Text Classification Model Based on Multi-level Constraint Augmentation and Label Association Attention

Learning Semantic Similarity For Multi-Label Text Categorization

MsCoa: Multi-Step Co-Attention Model for Multi-Label Classification

A Label Information Aware Model for Multi-label Text Classification

Multi-label text categorization using k-nearest neighbor approach with m-similarity

Improving Semi-Supervised Text Classification with Dual Meta-Learning

Hierarchical Multi-Label Text Categorization with Global Margin Maximization

An Efficient Framework by Topic Model for Multi-label Text Classification

Effective Multi-Label Active Learning for Text Classification

Hierarchical Multi-label Text Classification: Self-adaption Semantic Awareness Network Integrating Text Topic and Label Level Information

Effective Collaborative Representation Learning for Multilabel Text Categorization