Abstract:Quantification learning is the task of prevalence estimation for a test population using predictions from a classifier trained on a different population. Quantification methods assume that the sensitivities and specificities of the classifier are either perfect or transportable from the training to the test population. These assumptions are inappropriate in the presence of dataset shift, when the misclassification rates in the training population are not representative of those for the test population. Quantification under dataset shift has been addressed only for single-class (categorical) predictions and assuming perfect knowledge of the true labels on a small subset of the test population. We propose generalized Bayes quantification learning (GBQL) that uses the entire compositional predictions from probabilistic classifiers and allows for uncertainty in true class labels for the limited labeled test data. Instead of positing a full model, we use a model-free Bayesian estimating equation approach to compositional data based only on a first-moment assumption. The idea will be useful in Bayesian compositional data analysis in general as it is robust to different generating mechanisms for compositional data and includes categorical outputs as a special case. We show how our method yields existing quantification approaches as special cases. Extension to an ensemble GBQL that uses predictions from multiple classifiers yielding inference robust to inclusion of a poor classifier is discussed. We outline a fast and efficient Gibbs sampler using a rounding and coarsening approximation to the loss functions. We also establish posterior consistency, asymptotic normality and valid coverage of interval estimates from GBQL, as well as finite sample posterior concentration rate. Empirical performance of GBQL is demonstrated through simulations and analysis of real data with evident dataset shift.

Multi-Label Quantification

A Bayesian Network nearest k-labels method for Multi-label classification

MC-SQ and MC-MQ: Ensembles for Multi-class Quantification

Kernel Density Estimation for Multiclass Quantification

Distributed Semi-supervised Multi-label Classification with Quantized Communication

Regularization-Based Methods for Ordinal Quantification

Online Optimization Methods for the Quantification Problem

Binary quantification and dataset shift: an experimental investigation

Estimating Latent Relative Labeling Importances for Multi-label Learning

Multi-label Data Mining:A Survey

Large-Scale Multi-Label Learning with Incomplete Label Assignments

Unified Framework for Quantification

A Comparative Evaluation of Quantification Methods

Generalized Bayes Quantification Learning under Dataset Shift

Multi-Label Classification Via Manipulating Labels

Quantifying With Only Positive Training Data

Stochastic Optimization Techniques for Quantification Performance Measures.

Scalable Label Distribution Learning for Multi-Label Classification

Multi-label learning with missing and completely unobserved labels

Transductive Multilabel Learning Via Label Set Propagation