Abstract:The goal of semi-supervised text classification (SSTC) is to train a model by exploring both a small number of labeled data and a large number of unlabeled data, such that the learned semi-supervised classifier performs better than the supervised classifier trained on solely the labeled samples. Pseudo-labeling is one of the most widely used SSTC techniques, which trains a teacher classifier with a small number of labeled examples to predict pseudo labels for the unlabeled data. The generated pseudo-labeled examples are then utilized to train a student classifier, such that the learned student classifier can outperform the teacher classifier. Nevertheless, the predicted pseudo labels may be inaccurate, making the performance of the student classifier degraded. The student classifier may perform even worse than the teacher classifier. To alleviate this issue, in this paper, we introduce a dual meta-learning ( DML ) technique for semi-supervised text classification, which improves the teacher and student classifiers simultaneously in an iterative manner. Specifically, we propose a meta-noise correction method to improve the student classifier by proposing a Noise Transition Matrix (NTM) with meta-learning to rectify the noisy pseudo labels. In addition, we devise a meta pseudo supervision method to improve the teacher classifier. Concretely, we exploit the feedback performance from the student classifier to further guide the teacher classifier to produce more accurate pseudo labels for the unlabeled data. In this way, both teacher and student classifiers can co-evolve in the iterative training process. Extensive experiments on four benchmark datasets highlight the effectiveness of our DML method against existing state-of-the-art methods for semi-supervised text classification. We release our code and data of this paper publicly at https://github.com/GRIT621/DML.

Prototype-Guided Pseudo Labeling for Semi-Supervised Text Classification

Dual Pseudo Supervision for Semi-Supervised Text Classification with a Reliable Teacher

Semi-Supervised Text Classification Via Self-Paced Semantic-Level Contrast

Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning

Semi-Supervised Text Classification with Balanced Deep Representation Distributions

Semi-Supervised Text Detection with Accurate Pseudo-Labels

Improving Semi-Supervised Text Classification with Dual Meta-Learning

Prototype-Based Pseudo-Label Refinement for Semi-Supervised Hyperspectral Image Classification

Alternative Pseudo-Labeling for Semi-Supervised Automatic Speech Recognition

Twin Pseudo-training for Semi-Supervised Semantic Segmentation

Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation

Enhancing the Semi-supervised Semantic Segmentation with Prototype-based Supervision for Remote Sensing Images

Text Classification Method Based on Semi-Supervised Transfer Learning.

Semi-supervised Medical Image Classification Based on Class Prototype Matching for Soft Pseudo Labels with Consistent Regularization

Rethinking Pseudo Labels for Semi-Supervised Object Detection

Self-Paced Pairwise Representation Learning for Semi-Supervised Text Classification

Boundary-Aware Prototype in Semi-Supervised Medical Image Segmentation

A Small-Sample Text Classification Model Based on Pseudo-Label Fusion Clustering Algorithm

Semisupervised Particle Swarm Optimization for Classification

Semi-Supervised Text Classification Using Positive and Unlabeled Data

Balanced and Accurate Pseudo-Labels for Semi-Supervised Image Classification