Reliability of the 2021 National Youth Risk Behavior Survey Questionnaire

Sherry Everett Jones,Nancy D Brener,Barbara Queen,Molly Hershey-Arista,William A Harris,Jonetta J Mpofu,J Michael Underwood,Nancy D. Brener,William A. Harris,Jonetta J. Mpofu,J. Michael Underwood
DOI: https://doi.org/10.1177/08901171241239735
2024-03-17
American Journal of Health Promotion
Abstract:American Journal of Health Promotion, Ahead of Print. PurposeThe Youth Risk Behavior Survey (YRBS) monitors behaviors, experiences, and conditions affecting the health of high school students nationwide. This study examined the test-retest reliability of the 2021 national YRBS questionnaire.DesignRespondents completed a Time 1 and Time 2 paper-and-pencil questionnaire approximately 2 weeks apart during February to May 2022. Data were linked in such a way as to preserve anonymity.SettingConvenience sample of high schools.SubjectsHigh school students (N = 588).MeasuresHealth risk behaviors and experiences assessed on the 2021 national YRBS questionnaire.AnalysisTime 1 and Time 2 responses were compared for each questionnaire item using the McNemar's test. Then, Cohen's kappa coefficients tested the agreement between Time 1 and Time 2 responses overall, and by sex, grade, and Black, White, and Hispanic race and ethnicity.ResultsAmong the 74 items analyzed, 96% had at least moderate reliability, and 73% had substantial or almost perfect reliability. The mean Cohen's kappa was .68. McNemar's test findings showed Time 1 and Time 2 data significantly differed (P < .01) for 9 items (12%).ConclusionReliable health behavior measures are important in the development of youth-focused public health programs and policies. Findings suggest the national YRBS questionnaire is a reliable instrument. Such findings lend support to relying on adolescent self-reported data when monitoring health behaviors using the YRBS.
public, environmental & occupational health
What problem does this paper attempt to address?