Abstract:Positive and Unlabeled (PU) learning is a type of semi-supervised binary classification where the machine learning algorithm differentiates between a set of positive instances (labeled) and a set of both positive and negative instances (unlabeled). PU learning has broad applications in settings where confirmed negatives are unavailable or difficult to obtain, and there is value in discovering positives among the unlabeled (e.g., viable drugs among untested compounds). Most PU learning algorithms make the \emph{selected completely at random} (SCAR) assumption, namely that positives are selected independently of their features. However, in many real-world applications, such as healthcare, positives are not SCAR (e.g., severe cases are more likely to be diagnosed), leading to a poor estimate of the proportion, $\alpha$, of positives among unlabeled examples and poor model calibration, resulting in an uncertain decision threshold for selecting positives. PU learning algorithms vary; some estimate only the proportion, $\alpha$, of positives in the unlabeled set, while others calculate the probability that each specific unlabeled instance is positive, and some can do both. We propose two PU learning algorithms to estimate $\alpha$, calculate calibrated probabilities for PU instances, and improve classification metrics: i) PULSCAR (positive unlabeled learning selected completely at random), and ii) PULSNAR (positive unlabeled learning selected not at random). PULSNAR employs a divide-and-conquer approach to cluster SNAR positives into subtypes and estimates $\alpha$ for each subtype by applying PULSCAR to positives from each cluster and all unlabeled. In our experiments, PULSNAR outperformed state-of-the-art approaches on both synthetic and real-world benchmark datasets.

Asymmetric Loss for Positive-Unlabeled Learning.

Collective Loss Function for Positive and Unlabeled Learning.

Loss Decomposition and Centroid Estimation for Positive and Unlabeled Learning

Positive Unlabeled Contrastive Learning

Positive Unlabeled Learning Selected Not At Random (PULSNAR): class proportion estimation when the SCAR assumption does not hold

Split-PU: Hardness-aware Training Strategy for Positive-Unlabeled Learning

Positive and Unlabeled Learning through Negative Selection and Imbalance-aware Classification

Positive and Unlabeled Learning with Label Disambiguation

A boosting framework for positive-unlabeled learning

Verifying the Selected Completely at Random Assumption in Positive-Unlabeled Learning

Contrastive Approach to Prior Free Positive Unlabeled Learning

Large-Margin Label-Calibrated Support Vector Machines for Positive and Unlabeled Learning

Asymmetric Loss For Multi-Label Classification

Positive-Unlabeled Learning with Non-Negative Risk Estimator

A Boosting Algorithm for Positive-Unlabeled Learning

PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference

Uncertainty-aware Pseudo-label Selection for Positive-Unlabeled Learning

Positive-Unlabeled Learning by Latent Group-Aware Meta Disambiguation

Efficient Training for Positive Unlabeled Learning

Leveraged Asymmetric Loss with Disambiguation for Multi-label Recognition with One-Positive Annotations

Object Detection as a Positive-Unlabeled Problem