Abstract:Classifiers trained with Empirical Risk Minimization (ERM) tend to rely on attributes that have high spurious correlation with the target. This can degrade the performance on underrepresented (or 'minority') groups that lack these attributes, posing significant challenges for both out-of-distribution generalization and fairness objectives. Many studies aim to enhance robustness to spurious correlation, but they sometimes depend on group annotations for training. Additionally, a common limitation in previous research is the reliance on group-annotated validation datasets for model selection. This constrains their applicability in situations where the nature of the spurious correlation is not known, or when group labels for certain spurious attributes are not available. To enhance model robustness with minimal group annotation assumptions, we propose Environment-based Validation and Loss-based Sampling (EVaLS). It uses the losses from an ERM-trained model to construct a balanced dataset of high-loss and low-loss samples, mitigating group imbalance in data. This significantly enhances robustness to group shifts when equipped with a simple post-training last layer retraining. By using environment inference methods to create diverse environments with correlation shifts, EVaLS can potentially eliminate the need for group annotation in validation data. In this context, the worst environment accuracy acts as a reliable surrogate throughout the retraining process for tuning hyperparameters and finding a model that performs well across diverse group shifts. EVaLS effectively achieves group robustness, showing that group annotation is not necessary even for validation. It is a fast, straightforward, and effective approach that reaches near-optimal worst group accuracy without needing group annotations, marking a new chapter in the robustness of trained models against spurious correlation.

EMA: Auditing Data Removal from Trained Models

Cognitive Tracing Data Trails: Auditing Data Provenance in Discriminative Language Models Using Accumulated Discrepancy Score

Data Provenance via Differential Auditing

A General Framework for Data-Use Auditing of ML Models

Data AUDIT: Identifying Attribute Utility- and Detectability-Induced Bias in Task Models

FACE-AUDITOR: Data Auditing in Facial Recognition Systems

Insights into Data through Model Behaviour: An Explainability-driven Strategy for Data Auditing for Responsible Computer Vision Applications

SoK: Dataset Copyright Auditing in Machine Learning Systems

3D Masked Autoencoders with Application to Anomaly Detection in Non-Contrast Enhanced Breast MRI

Your Model Trains on My Data? Protecting Intellectual Property of Training Data via Membership Fingerprint Authentication

Nearly Tight Black-Box Auditing of Differentially Private Machine Learning

Exploratory Methods for Imbalanced Data Classification in Online Recruitment Fraud Detection: A Comparative Analysis

Hide in Plain Sight: Clean-Label Backdoor for Auditing Membership Inference

A Big Data-Driven Financial Auditing Method Using Convolution Neural Network

Auditing Visualizations: Transparency Methods Struggle to Detect Anomalous Behavior

Explaining Deep Learning for ECG Analysis: Building Blocks for Auditing and Knowledge Discovery

Tight Auditing of Differentially Private Machine Learning

Mask of truth: model sensitivity to unexpected regions of medical images

PANORAMIA: Privacy Auditing of Machine Learning Models without Retraining

Audit to Forget: A Unified Method to Revoke Patients' Private Data in Intelligent Healthcare

Trained Models Tell Us How to Make Them Robust to Spurious Correlation without Group Annotation