Abstract:Positive and Unlabeled (PU) learning is a type of semi-supervised binary classification where the machine learning algorithm differentiates between a set of positive instances (labeled) and a set of both positive and negative instances (unlabeled). PU learning has broad applications in settings where confirmed negatives are unavailable or difficult to obtain, and there is value in discovering positives among the unlabeled (e.g., viable drugs among untested compounds). Most PU learning algorithms make the \emph{selected completely at random} (SCAR) assumption, namely that positives are selected independently of their features. However, in many real-world applications, such as healthcare, positives are not SCAR (e.g., severe cases are more likely to be diagnosed), leading to a poor estimate of the proportion, $\alpha$, of positives among unlabeled examples and poor model calibration, resulting in an uncertain decision threshold for selecting positives. PU learning algorithms vary; some estimate only the proportion, $\alpha$, of positives in the unlabeled set, while others calculate the probability that each specific unlabeled instance is positive, and some can do both. We propose two PU learning algorithms to estimate $\alpha$, calculate calibrated probabilities for PU instances, and improve classification metrics: i) PULSCAR (positive unlabeled learning selected completely at random), and ii) PULSNAR (positive unlabeled learning selected not at random). PULSNAR employs a divide-and-conquer approach to cluster SNAR positives into subtypes and estimates $\alpha$ for each subtype by applying PULSCAR to positives from each cluster and all unlabeled. In our experiments, PULSNAR outperformed state-of-the-art approaches on both synthetic and real-world benchmark datasets.

Recovering the Propensity Score from Biased Positive Unlabeled Data

PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference

Instance-Dependent Positive and Unlabeled Learning With Labeling Bias Estimation

Joint empirical risk minimization for instance-dependent positive-unlabeled data

Instance-Dependent PU Learning by Bayesian Optimal Relabeling

Automatic Debiased Learning from Positive, Unlabeled, and Exposure Data

A boosting framework for positive-unlabeled learning

Verifying the Selected Completely at Random Assumption in Positive-Unlabeled Learning

Meta-learning for Positive-unlabeled Classification

Contrastive Approach to Prior Free Positive Unlabeled Learning

Positive-Unlabeled Learning with Non-Negative Risk Estimator

Augmented prediction of a true class for Positive Unlabeled data under selection bias

Asymmetric Loss for Positive-Unlabeled Learning.

Split-PU: Hardness-aware Training Strategy for Positive-Unlabeled Learning

A Boosting Algorithm for Positive-Unlabeled Learning

A new method for positive and unlabeled learning with privileged information

A Variational Approach for Learning from Positive and Unlabeled Data

Leveraging permutation testing to assess confidence in positive-unlabeled learning applied to high-dimensional biological datasets

Positive Unlabeled Learning Selected Not At Random (PULSNAR): class proportion estimation when the SCAR assumption does not hold

Improving Positive Unlabeled Learning: Practical AUL Estimation and New Training Method for Extremely Imbalanced Data Sets

Self-PU: Self Boosted and Calibrated Positive-Unlabeled Training