Abstract:Learning from Label Proportion (LLP) is a weakly supervised learning scenario in which training data is organized into predefined bags of instances, disclosing only the class label proportions per bag. This paradigm is essential for user modeling and personalization, where user privacy is paramount, offering insights into user preferences without revealing individual data. LLP faces a unique difficulty: the misalignment between bag-level supervision and the objective of instance-level prediction, primarily due to the inherent ambiguity in label proportion matching. Previous studies have demonstrated deep representation learning can generate auxiliary signals to promote the supervision level in the image domain. However, applying these techniques to tabular data presents significant challenges: 1) they rely heavily on label-invariant augmentation to establish multi-view, which is not feasible with the heterogeneous nature of tabular datasets, and 2) tabular datasets often lack sufficient semantics for perfect class distinction, making them prone to suboptimality caused by the inherent ambiguity of label proportion matching. To address these challenges, we propose an augmentation-free contrastive framework TabLLP-BDC that introduces class-aware supervision (explicitly aware of class differences) at the instance level. Our solution features a two-stage Bag Difference Contrastive (BDC) learning mechanism that establishes robust class-aware instance-level supervision by disassembling the nuance between bag label proportions, without relying on augmentations. Concurrently, our model presents a pioneering multi-task pretraining pipeline tailored for tabular-based LLP, capturing intrinsic tabular feature correlations in alignment with label proportion distribution. Extensive experiments demonstrate that TabLLP-BDC achieves state-of-the-art performance for LLP in the tabular domain.

Tabular Data Contrastive Learning via Class-Conditioned and Feature-Correlation Based Augmentation

SemanticMask: A Contrastive View Design for Anomaly Detection in Tabular Data

Local Contrastive Feature learning for Tabular Data

Class-aware and Augmentation-free Contrastive Learning from Label Proportion

Counterfactual Data Augmentation with Contrastive Learning

Semi-Supervised Learning with Data Augmentation for Tabular Data

Contrastive learning with text augmentation for text classification

Progressive Feature Upgrade in Semi-supervised Learning on Tabular Domain

Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning Via Augmentation Overlap

Counterfactual Contrastive Learning for Robust Text Classification

Differentiable Data Augmentation for Contrastive Sentence Representation Learning

Disentangling Tabular Data towards Better One-Class Anomaly Detection

Time Series Contrastive Learning with Information-Aware Augmentations

Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detection

Supervised contrastive representation learning with tree-structured parzen estimator Bayesian optimization for imbalanced tabular data

Contrastive adversarial learning in text classification tasks

A Study of Contrastive Self-Supervised Learning Generalization Based on Augmented Data

Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Views

Graph Contrastive Learning with Adaptive Augmentation

Time Series Classification Based on Data-Augmented Contrastive Learning.