Explorer Measuring Coverage in MNCH
Li Liu,Mengying Li,Li Yang,Lirong Ju,Biqin Tan,N. Walker,J. Bryce,H. Campbell,R. Black,Yan Guo
2013-01-01
Abstract:Background: Accurate data on coverage of key maternal, newborn, and child health (MNCH) interventions are crucial for monitoring progress toward the Millennium Development Goals 4 and 5. Coverage estimates are primarily obtained from routine population surveys through self-reporting, the validity of which is not well understood. We aimed to examine the validity of the coverage of selected MNCH interventions in Gongcheng County, China. Method and Findings: We conducted a validation study by comparing women’s self-reported coverage of MNCH interventions relating to antenatal and postnatal care, mode of delivery, and child vaccinations in a community survey with their paperand electronic-based health care records, treating the health care records as the reference standard. Of 936 women recruited, 914 (97.6%) completed the survey. Results show that self-reported coverage of these interventions had moderate to high sensitivity (0.57 [95% confidence interval (CI): 0.50–0.63] to 0.99 [95% CI: 0.98–1.00]) and low to high specificity (0 to 0.83 [95% CI: 0.80–0.86]). Despite varying overall validity, with the area under the receiver operating characteristic curve (AUC) ranging between 0.49 [95% CI: 0.39–0.57] and 0.90 [95% CI: 0.88–0.92], bias in the coverage estimates at the population level was small to moderate, with the test to actual positive (TAP) ratio ranging between 0.8 and 1.5 for 24 of the 28 indicators examined. Our ability to accurately estimate validity was affected by several caveats associated with the reference standard. Caution should be exercised when generalizing the results to other settings. Conclusions: The overall validity of self-reported coverage was moderate across selected MNCH indicators. However, at the population level, self-reported coverage appears to have small to moderate degree of bias. Accuracy of the coverage was particularly high for indicators with high recorded coverage or low recorded coverage but high specificity. The study provides insights into the accuracy of self-reports based on a population survey in lowand middle-income countries. Similar studies applying an improved reference standard are warranted in the future. Citation: Liu L, Li M, Yang L, Ju L, Tan B, et al. (2013) Measuring Coverage in MNCH: A Validation Study Linking Population Survey Derived Coverage to Maternal, Newborn, and Child Health Care Records in Rural China. PLoS ONE 8(5): e60762. doi:10.1371/journal.pone.0060762 Editor: Dr. Lucy Chappell, Kings Colleage London, United Kingdom, in consultation with Carla AbouZahr, independent consultant, health statistics and policy Received August 14, 2012; Accepted February 26, 2013; Published May 7, 2013 Copyright: 2013 Liu et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Funding: This work was conducted under the auspices of the Child Health Epidemiology Reference Group (CHERG) for WHO and UNICEF (No. 50140 and No. 43386), with financial support from The Bill & Melinda Gates Foundation through their grant to the US Fund for UNICEF. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Competing Interests: The authors have declared that no competing interests exist. Abbreviations: AUC, area under the receiver operating characteristic curve; CHERG, Child Health Epidemiology Reference Group; CI, confidence interval; DHS, Demographic and Health Survey/s; GMNCHIS, Gongcheng MNCH Information System; HBsAb, hepatitis B antibody; LMIC, lowand middle-income country; MICS, Multiple Indicator Cluster Surveys; MNCH, maternal, newborn, and child health; ROC, receiver operating characteristic; TAP, test to actual positive. * E-mail: guoyan@bjmu.edu.cn This paper is part of the PLOS Medicine ‘‘Measuring Coverage in