Abstract:Semi-supervised learning is a learning pattern that can utilize labeled data and unlabeled data to train deep neural networks. In semi-supervised learning methods, self-training-based methods do not depend on a data augmentation strategy and have better generalization ability. However, their performance is limited by the accuracy of predicted pseudo-labels. In this paper, we propose to reduce the noise in the pseudo-labels from two aspects: the accuracy of predictions and the confidence of the predictions. For the first aspect, we propose a similarity graph structure learning (SGSL) model that considers the correlation between unlabeled and labeled samples, which facilitates the learning of more discriminative features and, thus, obtains more accurate predictions. For the second aspect, we propose an uncertainty-based graph convolutional network (UGCN), which can aggregate similar features based on the learned graph structure in the training phase, making the features more discriminative. It can also output the uncertainty of predictions in the pseudo-label generation phase, generating pseudo-labels only for unlabeled samples with low uncertainty; thus, reducing the noise in the pseudo-labels. Further, a positive and negative self-training framework is proposed, which combines the proposed SGSL model and UGCN into the self-training framework for end-to-end training. In addition, in order to introduce more supervised signals in the self-training process, negative pseudo-labels are generated for unlabeled samples with low prediction confidence, and then the positive and negative pseudo-labeled samples are trained together with a small number of labeled samples to improve the performance of semi-supervised learning. The code is available upon request.

Semi-supervised learning based on nearest neighbor rule and cut edges

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Iterative Nearest Neighborhood Oversampling in Semisupervised Learning from Imbalanced Data

A soft nearest-neighbor framework for continual semi-supervised learning

A novel semi-supervised hyperspectral image classification approach based on spatial neighborhood information and classifier combination

Semi-supervised Image Classification Via Nonnegative Least-Squares Regression

Semi-Supervised Classification Using Linear Neighborhood Propagation

Semi-supervised support vector learning for face recognition

Semi-supervised learning method based on predefined evenly-distributed class centroids

Semi-Supervised Nearest Neighbor Discriminant Analysis Using Local Mean For Face Recognition

Toward Effective Semi-supervised Node Classification with Hybrid Curriculum Pseudo-labeling

MNN: Mixed Nearest-Neighbors for Self-Supervised Learning

Graph-Based Self-Training for Semi-Supervised Deep Similarity Learning

A Novel Semi-Supervised Method Based on Active Sample Proposal and Modified Self-Learning for SAR Target Discrimination

Nearest Neighbor Classifier Embedded Network for Active Learning

Semisupervised learning using negative labels.

Smooth Neighbors on Teacher Graphs for Semi-Supervised Learning

Semi-supervised feature selection by minimum neighborhood redundancy and maximum neighborhood relevancy

Semi-Supervised 3D Shape Segmentation via Self Refining

Rethinking Self-training for Semi-supervised Landmark Detection: A Selection-free Approach

Bias-Correction Feature Learner for Semi-Supervised Instance Segmentation