Abstract:In this paper we describe an efficient method for providing a regression model with a sense of curiosity about its data. In the field of machine learning, our framework for representing curiosity is called Active Learning, which means automatically choosing data points for which to query labels in the semisupervised setting. The methods we propose are based on computing a "regularity tangent" vector that can be calculated (with only a constant slow-down) together with the model's parameter vector during training. We then take the inner product of this tangent vector with the gradient vector of the model's loss at a given data point to obtain a measure of the influence of that point on the complexity of the model. There is only a single regularity tangent vector, of the same dimension as the parameter vector. Thus, in the proposed technique, once training is complete, evaluating our "curiosity" about a potential query data point can be done as quickly as calculating the model's loss gradient at that point. The new vector only doubles the amount of storage required by the model. We show that the quantity computed by our technique is an example of an "influence function", and that it measures the expected squared change in model complexity incurred by up-weighting a given data point. We propose a number of ways for using this quantity to choose new training data for a model in the framework of active learning.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to efficiently select unlabeled data points to query labels in the Active Learning framework in machine learning, thereby improving the efficiency of model training. Specifically, the author proposes a method based on "regularity tangent", which can evaluate the impact of potential query data points on model complexity without increasing the regression time complexity, and then select the most valuable data points for labeling. This method is not only applicable to large - scale models, but also can quickly calculate the degree of interest of the model in a certain candidate data point, that is, the so - called "curiosity". ### Main Contributions 1. **Propose a new method**: By calculating a "regularity tangent vector", which can be calculated in constant time during the training process together with the model parameter vector, so as to efficiently evaluate the impact of data points on model complexity. 2. **Use influence functions**: It is proved that the proposed method is an application of an influence function, which measures the expected squared change of model complexity change for a given data point. 3. **Efficient active learning strategies**: Several strategies for selecting new training data using the above - mentioned method are proposed, which can improve the training efficiency and performance of the model without significantly increasing the computational cost. ### Formula Explanations - **Regularity tangent vector**: Defined as \( \frac{d\theta^*}{ds} \), where \( \theta^* \) is the model parameter vector and \( s \) is the regularization parameter. - **Influence function**: Calculated as \( I_{\text{up}, \text{params}}(z) = -H^{-1} \frac{\partial L(z, \theta^*)}{\partial \theta} \), where \( H \) is the Hessian matrix and \( L(z, \theta^*) \) is the loss function. - **Estimation of loss change**: \( I_{\text{up}, \text{loss}}(z, z_{\text{test}}) = -\frac{\partial L(z_{\text{test}}, \theta^*)}{\partial \theta}^\top H^{-1} \frac{\partial L(z, \theta^*)}{\partial \theta} \) ### Application Scenarios - **Large - scale model training**: Applicable to very large models without significantly increasing the training time. - **Semi - supervised learning**: In the case of only a small amount of labeled data, improve the model performance by selecting the most informative unlabeled data points for labeling. In conclusion, the main goal of this paper is to provide an efficient and practical method to select the most valuable unlabeled data points by introducing "regularity tangent vectors" and influence functions, thereby optimizing the active learning process.

Influence functions and regularity tangents for efficient active learning

Capturing the Temporal Dependence of Training Data Influence

Studying Large Language Model Generalization with Influence Functions

Stepping on the Edge: Curvature Aware Learning Rate Tuners

Empirical influence functions to understand the logic of fine-tuning

Understanding Goal-Oriented Active Learning Via Influence Functions

Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult

Laplacian Regularized D-optimal Design for active learning and its application to image retrieval

Influence Functions in Deep Learning Are Fragile

The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes

A Versatile Influence Function for Data Attribution with Non-Decomposable Loss

A Model-free Closeness-of-influence Test for Features in Supervised Learning

Training Data Influence Analysis and Estimation: A Survey

Latent Variable Modeling with Diversity-Inducing Mutual Angular Regularization

Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel

CS4ML: A general framework for active learning with arbitrary data based on Christoffel functions

Regularizing Second-Order Influences for Continual Learning

DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models

A Graph-Based Approach for Active Learning in Regression

Influence Functions for Scalable Data Attribution in Diffusion Models