Methodologies and key considerations for implementing the International Classification of Diseases-11th revision morbidity coding: insights from a national pilot study in China

Meng Zhang,Yipeng Wang,Robert Jakob,Shanna Su,Xue Bai,Xiaotong Jing,Xin Xue,Aimin Liao,Naishi Li,Yi Wang

DOI: https://doi.org/10.1093/jamia/ocae031

2024-04-19

Abstract:Objective: The aim of this study was to disseminate insights from a nationwide pilot of the International Classification of Diseases-11th revision (ICD-11). Materials and methods: The strategies and methodologies employed to implement the ICD-11 morbidity coding in 59 hospitals in China are described. The key considerations for the ICD-11 implementation were summarized based on feedback obtained from the pilot hospitals. Coding accuracy and Krippendorff's alpha reliability were computed based on the coding results in the ICD-11 exam. Results: Among the 59 pilot hospitals, 58 integrated ICD-11 Coding Software into their health information management systems and 56 implemented the ICD-11 in morbidity coding, resulting in 3 723 959 diagnoses for 873 425 patients being coded over a 2-month pilot coding phase. The key considerations in the transition to the ICD-11 in morbidity coding encompassed the enrichment of ICD-11 content, refinement of tools, provision of systematic and tailored training, improvement of clinical documentation, promotion of downstream data utilization, and the establishment of a national process and mechanism for implementation. The overall coding accuracy was 82.9% when considering the entire coding field (including postcoordination) and 92.2% when only one stem code was considered. Krippendorff's alpha was 0.792 (95% CI, 0.788-0.796) and 0.799 (95% CI, 0.795-0.803) with and without consideration of the code sequence, respectively. Conclusion: This nationwide pilot study has enhanced national technical readiness for the ICD-11 implementation in morbidity, elucidating key factors warranting careful consideration in future endeavors. The good accuracy and intercoder reliability of the ICD-11 coding achieved following a brief training program underscore the potential for the ICD-11 to reduce training costs and provide high-quality health data. Experiences and lessons learned from this study have contributed to WHO's work on the ICD-11 and can inform other countries when formulating their transition plan.