Abstract:The goal of semi-supervised text classification (SSTC) is to train a model by exploring both a small number of labeled data and a large number of unlabeled data, such that the learned semi-supervised classifier performs better than the supervised classifier trained on solely the labeled samples. Pseudo-labeling is one of the most widely used SSTC techniques, which trains a teacher classifier with a small number of labeled examples to predict pseudo labels for the unlabeled data. The generated pseudo-labeled examples are then utilized to train a student classifier, such that the learned student classifier can outperform the teacher classifier. Nevertheless, the predicted pseudo labels may be inaccurate, making the performance of the student classifier degraded. The student classifier may perform even worse than the teacher classifier. To alleviate this issue, in this paper, we introduce a dual meta-learning ( DML ) technique for semi-supervised text classification, which improves the teacher and student classifiers simultaneously in an iterative manner. Specifically, we propose a meta-noise correction method to improve the student classifier by proposing a Noise Transition Matrix (NTM) with meta-learning to rectify the noisy pseudo labels. In addition, we devise a meta pseudo supervision method to improve the teacher classifier. Concretely, we exploit the feedback performance from the student classifier to further guide the teacher classifier to produce more accurate pseudo labels for the unlabeled data. In this way, both teacher and student classifiers can co-evolve in the iterative training process. Extensive experiments on four benchmark datasets highlight the effectiveness of our DML method against existing state-of-the-art methods for semi-supervised text classification. We release our code and data of this paper publicly at https://github.com/GRIT621/DML.

Improving Classification with Semi-Supervised and Fine-Grained Learning

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Semi-Supervised Learning for Fine-Grained Classification with Self-Training.

PEPL: Precision-Enhanced Pseudo-Labeling for Fine-Grained Image Classification in Semi-Supervised Learning

Selective Pseudo-Labeling with Reinforcement Learning for Semi-Supervised Domain Adaptation.

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Improving Semi-Supervised Text Classification with Dual Meta-Learning

Semi-supervised Medical Image Classification Combining Metric Pseudo-Label and Classification Pseudo-Label

Prototype-Based Pseudo-Label Refinement for Semi-Supervised Hyperspectral Image Classification

A Semi‐supervised Network Based on Feature Embeddings for Image Classification

MixLab: An Informative Semi-supervised Method for Multi-label Classification

Improved multi-class semi-supervised learning with boosting method

Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

Semi-supervised Multi-Label Feature Learning Via Label Enlarged Discriminant Analysis.

Several progress of semi-supervised learning

Webly-Supervised Fine-Grained Visual Categorization Via Deep Domain Adaptation.

Toward Effective Semi-supervised Node Classification with Hybrid Curriculum Pseudo-labeling

Semi-Supervised Ensemble Classification Method Based On Near Neighbor And Its Application

Pseudo-label refinement via hierarchical contrastive learning for source-free unsupervised domain adaptation

A Semi-Supervised Medical Image Classification Method Based on Combined Pseudo-Labeling and Distance Metric Consistency