How Poor Is Your Sample? A Simple Approach for Estimating the Relative Economic Status of Small and Nonrepresentative Samples
Jan Ostermann,Nicole Hair,Volker Grzimek,Siyu Zheng,Wenfeng Gong,Kathryn Whetten,Nathan Thielman
DOI: https://doi.org/10.9745/GHSP-D-22-00394
2023-04-28
Abstract:Background: Asset-based indices of living standards, or wealth indices, are widely used proxies for economic status; however, such indices are not readily available for small and nonrepresentative samples. Methods: We describe a simple out-of-sample prediction approach that uses estimates from large and representative "reference" samples to calculate measures of relative economic status (e.g., wealth index scores) for small and/or nonrepresentative "target" samples. The method relies on the availability of common variables and assumptions about comparable associations between these variables and the underlying construct of interest (e.g., household wealth). We provide 2 sample applications that use Demographic and Health Surveys (DHS) from 5 countries as reference samples. Using ordinary least squares regression, we estimate associations between household characteristics and the DHS wealth index. We use parameter estimates to predict wealth index scores for small nonrepresentative target samples. Comparisons of wealth distributions in the reference and target samples highlight selection effects. Results: Applications of the approach to diverse populations, including populations at high risk of HIV infection and households with orphaned and separated children, demonstrate its usefulness for characterizing the economic status of small and nonrepresentative samples relative to existing reference samples. Women and men in northern Tanzania at high risk of HIV infection were concentrated in the upper half of the wealth distribution. By contrast, the relative distribution of household wealth among households with orphaned and separated children varied greatly across countries and rural versus urban settings. Conclusions: Public health professionals who implement, manage, and evaluate programs in low- and middle-income countries may find this approach applicable because of the simplicity of the estimation methods, low marginal cost of primary data acquisition, and availability of established measures of relative economic status in many publicly available household surveys (e.g., those administered by the DHS Program, World Bank, International Labour Organization, and UNICEF).