Abstract:Semi-supervised learning (SSL) has been extensively studied to improve the generalization ability of deep neural networks for visual recognition. To involve the unlabelled data, most existing SSL methods are based on common density-based cluster assumption: samples lying in the same high-density region are likely to belong to the same class, including the methods performing consistency regularization or generating pseudo-labels for the unlabelled images. Despite their impressive performance, we argue three limitations exist: 1) Though the density information is demonstrated to be an important clue, they all use it in an implicit way and have not exploited it in depth. 2) For feature learning, they often learn the feature embedding based on the single data sample and ignore the neighborhood information. 3) For label-propagation based pseudo-label generation, it is often done offline and difficult to be end-to-end trained with feature learning. Motivated by these limitations, this paper proposes to solve the SSL problem by building a novel density-aware graph, based on which the neighborhood information can be easily leveraged and the feature learning and label propagation can also be trained in an end-to-end way. Specifically, we first propose a new Density-aware Neighborhood Aggregation(DNA) module to learn more discriminative features by incorporating the neighborhood information in a density-aware manner. Then a novel Density-ascending Path based Label Propagation(DPLP) module is proposed to generate the pseudo-labels for unlabeled samples more efficiently according to the feature distribution characterized by density. Finally, the DNA module and DPLP module evolve and improve each other end-to-end. Extensive experiments demonstrate the effectiveness of the newly proposed density-aware graph based SSL framework and our approach can outperform current state-of-the-art methods by a large margin.

End-To-End Graph-Based Deep Semi-Supervised Learning with Extended Graph Laplacian

Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Semi-Supervised Classification with Graph Structure Similarity and Extended Label Propagation

Semi-Supervised Learning Through Label Propagation on Geodesics

Fast Semisupervised Learning with Bipartite Graph for Large-Scale Data.

Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning.

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

Graph-based Semi-supervised Learning: A Comprehensive Review

Graph Based Semi-Supervised Learning Via Label Fitting

Density-Aware Graph for Deep Semi-Supervised Visual Recognition

Simultaneous Learning Of Affinity Matrix And Laplacian Regularized Least Squares For Semi-Supervised Classification

Deformed Graph Laplacian for Semisupervised Learning

Learnable Graph Convolutional Network with Semisupervised Graph Information Bottleneck.

Deep Growing Learning.

Safety-aware Graph-based Semi-Supervised Learning

Deep Graph-Convolutional Generative Adversarial Network for Semi-Supervised Learning on Graphs

Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning

Scalable and Inductive Semi-supervised Classifier with Sample Weighting Based on Graph Topology

Efficient And Robust Semi-Supervised Learning Over A Sparse-Regularized Graph

Semi-Supervised Learning with Close-Form Label Propagation Using a Bipartite Graph