Abstract:The critical challenge of semi-supervised semantic segmentation lies in how to fully exploit a large volume of unlabeled data to improve the model’s generalization performance for robust segmentation. Existing methods tend to employ certain criteria (weighting function) to select pixel-level pseudo labels. However, the trade-off exists between inaccurate yet utilized pseudo-labels, and correct yet discarded pseudo-labels in these methods when handling pseudo-labels without thoughtful consideration of the weighting function, hindering the generalization ability of the model. In this paper, we systematically analyze the trade-off in previous methods when dealing with pseudo-labels. We formally define the trade-off between inaccurate yet utilized pseudo-labels, and correct yet discarded pseudo-labels by explicitly modeling the confidence distribution of correct and inaccurate pseudo-labels, equipped with a unified weighting function. To this end, we propose Distribution-Aware Weighting (DAW) to strive to minimize the negative equivalence impact raised by the trade-off. We find an interesting fact that the optimal solution for the weighting function is a hard step function, with the jump point located at the intersection of the two confidence distributions. Besides, we devise distribution alignment to mitigate the issue of the discrepancy between the prediction distributions of labeled and unlabeled data. Extensive experimental results on multiple benchmarks including mitochondria segmentation demonstrate that DAW performs favorably against state-of-the-art methods.

Reducing Over-Weighting in Supervised Term Weighting for Sentiment Analysis.

Balancing between over-weighting and under-weighting in supervised term weighting

A study of supervised term weighting scheme for sentiment analysis

A Supervised Term Weighting Scheme for Multi-class Text Categorization

An improved supervised term weighting scheme for text representation and classification

A Novel Term Weighting Scheme for Automated Text Categorization

Several alternative term weighting methods for text representation and classification

Supervised Term Weighting Metrics for Sentiment Analysis in Short Text

TF-IDFC-RF: A Novel Supervised Term Weighting Scheme

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

A Study of the Application of Weight Distributing Method Combining Sentiment Dictionary and TF-IDF for Text Sentiment Analysis

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

Exploiting Category Information and Document Information to Improve Term Weighting for Text Categorization

Supervised Contrastive Learning with Term Weighting for Improving Chinese Text Classification

New term weighting schemes with combination of multiple classifiers for sentiment analysis

Improve Precategorized Collection Retrieval by Using Supervised Term Weighting Schemes

Using modified term frequency to improve term weighting for text classification

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization

DAW: Exploring the Better Weighting Function for Semi-supervised Semantic Segmentation.

A generic multi-level framework for building term-weighting schemes in text classification