Abstract:Summary Probability weights have been widely used in addressing selection bias arising from a variety of contexts. Common examples of probability weights include sampling weights, missing data weights, and propensity score weights. Frequency weights, which are used to control for varying variabilities of aggregated outcomes, are both conceptually and analytically different from probability weights. Popular software such as R, SAS and STATA support both types of weights. Many users, including professional statisticians, become bewildered when they see identical estimates, but different standard errors and p ‐values when probability weights are treated as frequency weights. Some even completely ignore the difference between the two types of weights and treat them as the same. Although a large body of literature exists on each type of weights, we have found little, if any, discussion that provides head‐to‐head comparisons of the two types of weights and associated inference methods. In this paper, we unveil the conceptual and analytic differences between the two types of weights within the context of parametric and semi‐parametric generalised linear models (GLM) and discuss valid inference for each type of weights. To the best of our knowledge, this is the first paper that looks into such differences by identifying the conditions under which the two types of weights can be treated the same analytically and providing clear guidance on the appropriate statistical models and inference procedures for each type of weights. We illustrate these considerations using real study data.

Conditional Independence Test for Weights-of-Evidence Modeling

Assessing the Performance of the Independence Method in Modeling Spatial Extreme Rainfall

Dempster conditioning and conditional independence in evidence theory

Testing for Pairwise Serial Independence Via the Empirical Distribution Function

Conditional independence testing via weighted partial copulas and nearest neighbors

Flexible model weighting for one-dependence estimators based on point-wise independence analysis

A Conditional Independence Test in the Presence of Discretization

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Conditional Independence Testing for Discrete Distributions: Beyond $χ^2$- and $G$-tests

Combination Weighting Approach Based on Deviation Function and Joint-Entropy

Model-X Sequential Testing for Conditional Independence via Testing by Betting

Conditional Independence Specification Testing for Dependent Processes with Local Polynomial Quantile Regression

A NONPARAMETRIC HELLINGER METRIC TEST FOR CONDITIONAL INDEPENDENCE

On Frequency and Probability Weights: An In‐Depth Look at Duelling Weights

A formal goodness-of-fit test for spatial binary Markov random field models

Nearly Minimax Optimal Wasserstein Conditional Independence Testing

Graphical tests of independence for general distributions

A Consistent Characteristic Function-Based Test for Conditional Independence

Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information

A Conditional Distribution Function-Based Measure for Independence and K-sample Tests in Multivariate Data

A Ball Divergence Based Measure For Conditional Independence Testing