Abstract:Background: International Classification of Diseases codes are widely used to describe diagnosis information, but manual coding relies heavily on human interpretation, which can be expensive, time consuming, and prone to errors. With the transition from the International Classification of Diseases, Ninth Revision, to the International Classification of Diseases, Tenth Revision (ICD-10), the coding process has become more complex, highlighting the need for automated approaches to enhance coding efficiency and accuracy. Inaccurate coding can result in substantial financial losses for hospitals, and a precise assessment of outcomes generated by a natural language processing (NLP)-driven autocoding system thus assumes a critical role in safeguarding the accuracy of the Taiwan diagnosis related groups (Tw-DRGs). Objective: This study aims to evaluate the feasibility of applying an International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), autocoding system that can automatically determine diagnoses and codes based on free-text discharge summaries to facilitate the assessment of Tw-DRGs, specifically principal diagnosis and major diagnostic categories (MDCs). Methods: By using the patient discharge summaries from Kaohsiung Medical University Chung-Ho Memorial Hospital (KMUCHH) from April 2019 to December 2020 as a reference data set we developed artificial intelligence (AI)-assisted ICD-10-CM coding systems based on deep learning models. We constructed a web-based user interface for the AI-assisted coding system and deployed the system to the workflow of the certified coding specialists (CCSs) of KMUCHH. The data used for the assessment of Tw-DRGs were manually curated by a CCS with the principal diagnosis and MDC was determined from discharge summaries collected at KMUCHH from February 2023 to April 2023. Results: Both the reference data set and real hospital data were used to assess performance in determining ICD-10-CM coding, principal diagnosis, and MDC for Tw-DRGs. Among all methods, the GPT-2 (OpenAI)-based model achieved the highest F1-score, 0.667 (F1-score 0.851 for the top 50 codes), on the KMUCHH test set and a slightly lower F1-score, 0.621, in real hospital data. Cohen κ evaluation for the agreement of MDC between the models and the CCS revealed that the overall average κ value for GPT-2 (κ=0.714) was approximately 12.2 percentage points higher than that of the hierarchy attention network (κ=0.592). GPT-2 demonstrated superior agreement with the CCS across 6 categories of MDC, with an average κ value of approximately 0.869 (SD 0.033), underscoring the effectiveness of the developed AI-assisted coding system in supporting the work of CCSs. Conclusions: An NLP-driven AI-assisted coding system can assist CCSs in ICD-10-CM coding by offering coding references via a user interface, demonstrating the potential to reduce the manual workload and expedite Tw-DRG assessment. Consistency in performance affirmed the effectiveness of the system in supporting CCSs in ICD-10-CM coding and the judgment of Tw-DRGs.

Development and Validation of an Algorithm to Classify as Equivalent the Procedures in ICD-10-PCS That Differ Only by Laterality

A Hybrid Method for Icd-10 Auto-Coding of Chinese Diagnoses

Automatic ICD-10 Coding Algorithm Using an Improved Longest Common Subsequence Based on Semantic Similarity

Assessing the accuracy gap in early postoperative complication surveillance: ICD-10 codes versus manual curation—clinical and economic implications

A retrospective analysis using comorbidity detecting algorithmic software to determine the incidence of International Classification of Diseases (ICD) code omissions and appropriateness of Diagnosis-Related Group (DRG) code modifiers

Development and validation of a structured query language implementation of the Elixhauser comorbidity index

A Study of Clinical Coding Accuracy in Surgery: Implications for the Use of Administrative Big Data for Outcomes Management

[Prospective DRG coding : Improvement in cost-effectiveness and documentation quality of in-patient hospital care]

Improving Accuracy of Administrative Data for Perforated Appendicitis Classification

Patients Undergoing Elective Inpatient Major Therapeutic Procedures in Florida Had No Significant Change in Hospital Mortality or Mortality-Related Comorbidities Between 2007 and 2019

We Are Not Speaking the Same Language: Current Procedural Terminology Coding and Provision of Care in Lymphatic Reconstruction

Predictive Hierarchical Clustering: Learning clusters of CPT codes for improving surgical outcomes

Coding rules for uncertain and "ruled out" diagnoses in ICD-10 and ICD-11

Comparing terminology mappings to ICD-10 coded data in Discharge Abstract Database (DAD) in Alberta, Canada

An audit of the nature and impact of clinical coding subjectivity variability and error in otolaryngology

Adaptability of High Dimensional Propensity Score Procedure in the Transition from ICD-9 to ICD-10 in the US Healthcare System

Utilizing International Classification of Diseases Codes to Identify Shoulder Dystocia and Neonatal Brachial Plexus Injury

Evaluating a Natural Language Processing-Driven, AI-Assisted International Classification of Diseases, 10th Revision, Clinical Modification, Coding System for Diagnosis Related Groups in a Real Hospital Environment: Algorithm Development and Validation Study

Defining the emergency general surgery patient population in the era of ICD-10 : Evaluating an established crosswalk from ICD-9 to ICD-10 diagnosis codes

Enhancing Hospital Reimbursement Through a Pediatric Surgery Resident Orientation Program: A Focus on Accurate Diagnosis Code Documentation for Acute Appendicitis

Results from the Veterans Health Administration ICD-10-CM/PCS Coding Pilot Study