Beyond a coefficient: an interactive process for achieving inter-rater consistency in qualitative coding

Vonna L Hemmler,Allison W Kenney,Susan Dulong Langley,Carolyn M Callahan,E. Jean Gubbins,Shannon Holder
DOI: https://doi.org/10.1177/1468794120976072
2020-12-10
Qualitative Research
Abstract:Though qualitative research has become more prevalent in practice over the last 30 years, there is still considerable uncertainty among researchers regarding how to ensure inter-rater consistency when teams are tasked with coding qualitative data. In this article, we offer an explanation of a methodology that our qualitative team used to achieve systematic coding of our dataset in a way that preserved the contextual, subjective nature of the data, lent itself to the deductive and inductive creation of a layered codebook, and ensured consistent application of the codebook to varied types of data. This methodology prepared us to draw logical and substantiated conclusions during subsequent analyses; hence, the process serves as a welcome addition to the literature on consistently coding qualitative data in a manner that honors its defining characteristics.
sociology,social sciences, interdisciplinary
What problem does this paper attempt to address?