Abstract:Large-scale black-box models have become ubiquitous across numerous applications. Understanding the influence of individual training data sources on predictions made by these models is crucial for improving their trustworthiness. Current influence estimation techniques involve computing gradients for every training point or repeated training on different subsets. These approaches face obvious computational challenges when scaled up to large datasets and models. In this paper, we introduce and explore the Mirrored Influence Hypothesis, highlighting a reciprocal nature of influence between training and test data. Specifically, it suggests that evaluating the influence of training data on test predictions can be reformulated as an equivalent, yet inverse problem: assessing how the predictions for training samples would be altered if the model were trained on specific test samples. Through both empirical and theoretical validations, we demonstrate the wide applicability of our hypothesis. Inspired by this, we introduce a new method for estimating the influence of training data, which requires calculating gradients for specific test samples, paired with a forward pass for each training point. This approach can capitalize on the common asymmetry in scenarios where the number of test samples under concurrent examination is much smaller than the scale of the training dataset, thus gaining a significant improvement in efficiency compared to existing approaches. We demonstrate the applicability of our method across a range of scenarios, including data attribution in diffusion models, data leakage detection, analysis of memorization, mislabeled data detection, and tracing behavior in language models. Our code will be made available at <a class="link-external link-https" href="https://github.com/ruoxi-jia-group/Forward-INF" rel="external noopener nofollow">this https URL</a>.

Mining Influential Training Data by Tracing Influence on Hard Validation Samples

Workshop on Model Mining

Training Data Influence Analysis and Estimation: A Survey

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Example Mining for Incremental Learning in Medical Imaging

A Model Compression Method Using Significant Data and Knowledge Distillation

DIVINE: Diverse Influential Training Points for Data Visualization and Model Refinement

Finding Key Training Data by Calculating Influence Score.

Dataset Pruning: Reducing Training Data by Examining Generalization Influence

Outlier Gradient Analysis: Efficiently Identifying Detrimental Training Samples for Deep Learning Models

The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes

Deep Learning on a Data Diet: Finding Important Examples Early in Training

Mining Data Impressions From Deep Models as Substitute for the Unavailable Training Data

Accelerating Neural Field Training via Soft Mining

Make the Most of Your Data: Changing the Training Data Distribution to Improve In-distribution Generalization Performance

Mining Hard Samples Globally and Efficiently for Person Reidentification

Harnessing Diversity for Important Data Selection in Pretraining Large Language Models

Do Deep Neural Networks Always Perform Better when Eating More Data?

Cost-Effective Testing of a Deep Learning Model Through Input Reduction

Large-Scale Dataset Pruning in Adversarial Training through Data Importance Extrapolation