Reliable for Whom? Inferring and Reporting Reliability across Diverse Populations

Richard S. Balkin,Quentin Hunter,Bradley T. Erford
DOI: https://doi.org/10.1080/07481756.2023.2301286
2024-02-24
Measurement and Evaluation in Counseling and Development
Abstract:We describe best practices in reporting reliability estimates in counseling research with consideration to precision, generalization, and diverse populations. We provide a historical context to reporting reliability estimates, the limitations of past practices, and new methods to address reliability generalization. We highlight best practices including consideration of reliability estimates as function of scores, not scale, diverse sample, hierarchy of reporting reliability estimates, and methods of reliability generalization. Best practices in evaluating and reporting reliability estimates in counseling research are addressed. We consider the interpretation of reliability estimates across diverse populations; limitations of reliability estimates for common, published measures; and the reporting of reliability estimates in the practice of research and publication.
psychology, educational, applied
What problem does this paper attempt to address?