Abstract:Learning from label proportions (LLP) is a kind of weakly supervised learning that trains an instance-level classifier from label proportions of bags, which consist of sets of instances without using instance labels. A challenge in LLP arises when the number of instances in a bag (bag size) is numerous, making the traditional LLP methods difficult due to GPU memory limitations. This study aims to develop an LLP method capable of learning from bags with large sizes. In our method, smaller bags (mini-bags) are generated by sampling instances from large-sized bags (original bags), and these mini-bags are used in place of the original bags. However, the proportion of a mini-bag is unknown and differs from that of the original bag, leading to overfitting. To address this issue, we propose a perturbation method for the proportion labels of sampled mini-bags to mitigate overfitting to noisy label proportions. This perturbation is added based on the multivariate hypergeometric distribution, which is statistically modeled. Additionally, loss weighting is implemented to reduce the negative impact of proportions sampled from the tail of the distribution. Experimental results demonstrate that the proportion label perturbation and loss weighting achieve classification accuracy comparable to that obtained without sampling. Our codes are available at <a class="link-external link-https" href="https://github.com/stainlessnight/LLP-LargeBags" rel="external noopener nofollow">this https URL</a>.

Learning with Label Proportions Based on Nonparallel Support Vector Machines

$\propto$SVM for learning with label proportions

Two-stage Training for Learning from Label Proportions

OT-LLP: Optimal Transport for Learning from Label Proportions

Learning from Label Proportions by Learning with Label Noise

Learning under Label Proportions for Text Classification

Learning from Label Proportions with Consistency Regularization

A Multi-Class Large Margin Classifier

Learning from Label Proportions with Instance-wise Consistency

A Novel Projection Nonparallel Support Vector Machine for Pattern Classification

Semi-Supervised Learning with Label Proportion

Learning from Label Proportions: Bootstrapping Supervised Learners via Belief Propagation

Forming Auxiliary High-confident Instance-level Loss to Promote Learning from Label Proportions

Theoretical Proportion Label Perturbation for Learning from Label Proportions in Large Bags

Learning from Label Proportions with Generative Adversarial Networks

Transfer Learning-Based Label Proportions Method with Data of Uncertainty

Manifold Proximal Support Vector Machine with Mixed-Norm for Semi-Supervised Classification

Learning from Label Proportions and Covariate-shifted Instances

Optimistic Rates for Learning from Label Proportions

Parallel Proximal Support Vector Machine for High-Dimensional Pattern Classification

Robust L1-Norm Non-Parallel Proximal Support Vector Machine