Abstract:In this paper, we study weakly supervised learning where a large amount of data supervision is not accessible. This includes i) incomplete supervision, where only a small subset of labels is given, such as semi-supervised learning and domain adaptation; ii) inexact supervision, where only coarse-grained labels are given, such as multi-instance learning and iii) inaccurate supervision, where the given labels are not always ground-truth, such as label noise learning. Unlike supervised learning which typically achieves performance improvement with more labeled examples, weakly supervised learning may sometimes even degenerate performance with more weakly supervised data. Such deficiency seriously hinders the deployment of weakly supervised learning to real tasks. It is thus highly desired to study safe weakly supervised learning, which never seriously hurts performance. To this end, we present a generic ensemble learning scheme to derive a safe prediction by integrating multiple weakly supervised learners. We optimize the worst-case performance gain and lead to a maximin optimization. This brings multiple advantages to safe weakly supervised learning. First, for many commonly used convex loss functions in classification and regression, it is guaranteed to derive a safe prediction under a mild condition. Second, prior knowledge related to the weight of the base weakly supervised learners can be flexibly embedded. Third, it can be globally and efficiently addressed by simple convex quadratic or linear program. Finally, it is in an intuitive geometric interpretation with the least square loss. Extensive experiments on various weakly supervised learning tasks, including semi-supervised learning, domain adaptation, multi-instance learning and label noise learning demonstrate our effectiveness.

Weakly Supervised Learning Meets Ride-Sharing User Experience Enhancement

IWE-Net: Instance Weight Network for Locating Negative Comments and Its Application to Improve Traffic User Experience

Understanding Ridesplitting Behavior of On-Demand Ride Services: an Ensemble Learning Approach

DCS: Debiased Contrastive Learning with Weak Supervision for Time Series Classification

Learning from Imbalanced and Incomplete Supervision with Its Application to Ride-Sharing Liability Judgment

Reliable Weakly Supervised Learning: Maximize Gain and Maintain Safeness

An Improved Semi-Supervised Learning Method for Software Defect Prediction.

Rethinking Weak Supervision in Helping Contrastive Learning

Towards Safe Weakly Supervised Learning

A General Framework for Learning from Weak Supervision

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

Constrained Labeling for Weakly Supervised Learning

Weakly Supervised Multi-Label Learning Via Label Enhancement

Learning From Semi-Supervised Weak-Label Data

Co-Supervised Learning: Improving Weak-to-Strong Generalization with Hierarchical Mixture of Experts

Weakly Supervised Fine-grained Recognition Based on Combined Learning for Small Data and Coarse Label

Context-aware Route Recommendation with Weight Learning Through Deep Neural Networks

Data Consistency for Weakly Supervised Learning

Debiased Contrastive Learning of Unsupervised Sentence Representations

A Weakly Supervised Learning Approach for Spoken Language Understanding.