Abstract:The concept of probabilistic values, such as Beta Shapley values and weighted Banzhaf values, has gained recent attention in applications like feature attribution and data valuation. However, exact computation of these values is often exponentially expensive, necessitating approximation techniques. Prior research has shown that the choice of probabilistic values significantly impacts downstream performance, with no universally superior option. Consequently, one may have to approximate multiple candidates and select the best-performing one. Although there have been many efforts to develop efficient estimators, none are intended to approximate all probabilistic values both simultaneously and efficiently. In this work, we embark on the first exploration of achieving this goal. Adhering to the principle of maximum sample reuse, we propose a one-sample-fits-all framework parameterized by a sampling vector to approximate intermediate terms that can be converted to any probabilistic value without amplifying scalars. Leveraging the concept of $ (\epsilon, \delta) $-approximation, we theoretically identify a key formula that effectively determines the convergence rate of our framework. By optimizing the sampling vector using this formula, we obtain i) a one-for-all estimator that achieves the currently best time complexity for all probabilistic values on average, and ii) a faster generic estimator with the sampling vector optimally tuned for each probabilistic value. Particularly, our one-for-all estimator achieves the fastest convergence rate on Beta Shapley values, including the well-known Shapley value, both theoretically and empirically. Finally, we establish a connection between probabilistic values and the least square regression used in (regularized) datamodels, showing that our one-for-all estimator can solve a family of datamodels simultaneously.

Approximating the Shapley Value Using Stratified Empirical Bernstein Sampling

Efficient Sampling Approaches to Shapley Value Approximation

Shapley Value Approximation Based on Complementary Contribution

Approximating the Shapley Value without Marginal Contributions

A Multilinear Sampling Algorithm to Estimate Shapley Values

Fast Approximation of the Shapley Values Based on Order-of-Addition Experimental Designs

Estimation of the Shapley Value of a Peer-to-Peer Energy Sharing Game using Coalitional Stratified Random Sampling

Efficient Methods for Approximating the Shapley Value for Asset Sharing in Energy Communities

Absolute Shapley Value

Variance reduced shapley value estimation for trustworthy data valuation

Evaluate the Contribution of Multiple Participants in Federated Learning

Improving the Sampling Strategy in KernelSHAP

One Sample Fits All: Approximating All Probabilistic Values Simultaneously and Efficiently

A Comparative Study of Methods for Estimating Conditional Shapley Values and When to Use Them

P-Shapley: Shapley Values on Probabilistic Classifiers

DU-Shapley: A Shapley Value Proxy for Efficient Dataset Valuation

Provably Accurate Shapley Value Estimation via Leverage Score Sampling

Approximating power indices: theoretical and empirical analysis

Computing the Shapley Value in Allocation Problems: Approximations and Bounds, with an Application to the Italian VQR Research Assessment Program

Shapley Meets Shapley

Towards Data Valuation via Asymmetric Data Shapley