Defending the mucosa: adjuvant and carrier formulations for mucosal immunity.

L. Lawson,E. Norton,J. Clements

DOI: https://doi.org/10.1016/j.coi.2011.03.009

IF: 7.268

2011-06-01

Current Opinion in Immunology

Abstract:

What problem does this paper attempt to address?

A Hybrid Method for Icd-10 Auto-Coding of Chinese Diagnoses

Zheng Jia,Weifeng Qin,Huilong Duan,Xudong Lv,Haomin Li

DOI: https://doi.org/10.3233/978-1-61499-830-3-427

2017-01-01

Abstract:The Chinese Version of Classification and Codes of Diseases (CCD) is an expanded version of ICD-10. Hospitals are required to assign CCD codes to discharge diagnoses in China. To handle the contradiction between a shortage of skilled CCD coders and increasing coding efficiency, a CCD auto-coding method is urgently needed. In this study a hybrid auto-coding method was proposed based on the lexical characteristics obtained through the analysis of a corpus of 1537 diagnoses with normative CCD code. It combines the rule-based approach, the Chinese characters-based distributed semantic similarity and the dictionary-based approach. The rule-based approach was proved to be efficient and precise at the cost of time and manpower. The semantic similarity approach shows poor performance. The old-fashioned dictionary-based approach ends in leading significance. The final accuracy of this hybrid approach is 96.9% in the test.
Automatic International Classification of Diseases Coding System: Deep Contextualized Language Model With Rule-Based Approaches

Pei-Fu Chen,Kuan-Chih Chen,Wei-Chih Liao,Feipei Lai,Tai-Liang He,Sheng-Che Lin,Wei-Jen Chen,Chi-Yu Yang,Yu-Cheng Lin,I-Chang Tsai,Chi-Hao Chiu,Shu-Chih Chang,Fang-Ming Hung

DOI: https://doi.org/10.2196/37557

IF: 3.2

2022-06-30

JMIR Medical Informatics

Abstract:Background: The tenth revision of the International Classification of Diseases (ICD-10) is widely used for epidemiological research and health management. The clinical modification (CM) and procedure coding system (PCS) of ICD-10 were developed to describe more clinical details with increasing diagnosis and procedure codes and applied in disease-related groups for reimbursement. The expansion of codes made the coding time-consuming and less accurate. The state-of-the-art model using deep contextual word embeddings was used for automatic multilabel text classification of ICD-10. In addition to input discharge diagnoses (DD), the performance can be improved by appropriate preprocessing methods for the text from other document types, such as medical history, comorbidity and complication, surgical method, and special examination. Objective: This study aims to establish a contextual language model with rule-based preprocessing methods to develop the model for ICD-10 multilabel classification. Methods: We retrieved electronic health records from a medical center. We first compared different word embedding methods. Second, we compared the preprocessing methods using the best-performing embeddings. We compared biomedical bidirectional encoder representations from transformers (BioBERT), clinical generalized autoregressive pretraining for language understanding (Clinical XLNet), label tree-based attention-aware deep model for high-performance extreme multilabel text classification (AttentionXLM), and word-to-vector (Word2Vec) to predict ICD-10-CM. To compare different preprocessing methods for ICD-10-CM, we included DD, medical history, and comorbidity and complication as inputs. We compared the performance of ICD-10-CM prediction using different preprocesses, including definition training, external cause code removal, number conversion, and combination code filtering. For the ICD-10 PCS, the model was trained using different combinations of DD, surgical method, and key words of special examination. The micro F 1 score and the micro area under the receiver operating characteristic curve were used to compare the model's performance with that of different preprocessing methods. Results: BioBERT had an F 1 score of 0.701 and outperformed other models such as Clinical XLNet, AttentionXLM, and Word2Vec. For the ICD-10-CM, the model had an F 1 score that significantly increased from 0.749 (95% CI 0.744-0.753) to 0.769 (95% CI 0.764-0.773) with the ICD-10 definition training, external cause code removal, number conversion, and combination code filter. For the ICD-10-PCS, the model had an F 1 score that significantly increased from 0.670 (95% CI 0.663-0.678) to 0.726 (95% CI 0.719-0.732) with a combination of discharge diagnoses, surgical methods, and key words of special examination. With our preprocessing methods, the model had the highest area under the receiver operating characteristic curve of 0.853 (95% CI 0.849-0.855) and 0.831 (95% CI 0.827-0.834) for ICD-10-CM and ICD-10-PCS, respectively. Conclusions: The performance of our model with the pretrained contextualized language model and rule-based preprocessing method is better than that of the state-of-the-art model for ICD-10-CM or ICD-10-PCS. This study highlights the importance of rule-based preprocessing methods based on coder coding rules.

medical informatics
Automatic ICD-10 coding: Deep semantic matching based on analogical reasoning

Yani Chen,Han Chen,Xudong Lu,Huilong Duan,Shilin He,Jiye An

DOI: https://doi.org/10.1016/j.heliyon.2023.e15570

IF: 3.776

2023-04-19

Heliyon

Abstract:Background: ICD-10 has been widely used in statistical analysis of mortality rates and medical reimbursement. Automatic ICD-10 coding is desperately needed because manually assigning codes is expensive, time-consuming, and labor-intensive. Diagnoses described in medical records differ significantly from those used in ICD-10 classification, making it impossible for existing automatic coding techniques to perform well enough to support medical billing, resource allocation, and research requirements. Meanwhile, most of the current automatic coding approaches are oriented toward English ICD-10. This method for automatically assigning ICD-10 codes to diagnoses extracted from Chinese discharge records was provided in this paper. Method: First, BERT creates word representations of the two texts. Second, the context representation layer incorporates contextual information into the representation of each time step of the word representations using a bidirectional Long Short-Term Memory. Third, the matching layer compares each contextual embedding of the uncoded diagnosis record against a weighted version of all contextual character embeddings of the manually coded diagnosis record. The matching strategy is element-wise subtraction and element-wise multiplication and then through a neural network layer. Fourth, the matching vectors are combined using a one-layer convolutional neural network. A sigmoid is then used to output matching results. Results: To evaluate the proposed method, 1,003,558 manually coded primary diagnoses were gathered from the homepage of the discharge medical records. The experimental results showed that the proposed method outperformed popular deep semantic matching algorithms, such as DSSM, ConvNet, ESIM, and ABCNN, and demonstrated state-of-the-art results in a single text matching with an accuracy of 0.986, a precision of 0.979, a recall of 0.983, and an F1-score of 0.981. Conclusion: The automatic ICD-10 coding of Chinese diagnoses is successful when using the proposed deep semantic matching approach based on analogical reasoning.
Automatic ICD-10 Coding Algorithm Using an Improved Longest Common Subsequence Based on Semantic Similarity

YunZhi Chen,HuiJuan Lu,LanJuan Li

DOI: https://doi.org/10.1371/journal.pone.0173410

IF: 3.7

2017-01-01

PLoS ONE

Abstract:ICD-10(International Classification of Diseases 10th revision) is a classification of a disease, symptom, procedure, or injury. Diseases are often described in patients’ medical records with free texts, such as terms, phrases and paraphrases, which differ significantly from those used in ICD-10 classification. This paper presents an improved approach based on the Longest Common Subsequence (LCS) and semantic similarity for automatic Chinese diagnoses, mapping from the disease names given by clinician to the disease names in ICD-10. LCS refers to the longest string that is a subsequence of every member of a given set of strings. The proposed method of improved LCS in this paper can increase the accuracy of processing in Chinese disease mapping.
Modelling long medical documents and code associations for explainable automatic ICD coding

Wen-hui Hou,Xiao-kang Wang,Ya-nan Wang,Jian-qiang Wang,Fei Xiao

DOI: https://doi.org/10.1016/j.eswa.2024.123519

IF: 8.5

2024-02-22

Expert Systems with Applications

Abstract:Quick and accurate International Classification of Diseases (ICD) code assignment is vital for billing, reimbursement and medical research. Owing to the labour-intensive and error-prone nature of manual coding, automatic ICD coding using deep learning methods has flourished. However, this task is still challenging because of (1) the interpretability of coding, (2) lengthy clinical documents and (3) long-tail label distribution. In the current study, we propose a novel automatic ICD coding framework to address these issues. First, a biomedical-specific pre-trained language model, Clinical-Longformer, is used as an encoder, which generates meaningful representations of long clinical documents by injecting rich medical knowledge and capturing long-distance dependence among tokens. Second, a decoding architecture that combines the multi-synonym attention mechanism, hierarchical curriculum learning and distribution-balance loss is designed to perform ICD code prediction. The decoder improves the tail-end performance by fully capturing code associations in terms of semantics, structure and co-occurrence. In addition, the label-wise attention mechanism provides the interpretability of prediction. Experimental results on benchmark MIMIC-III datasets indicate that our model achieves higher F1 scores than previous state-of-the-art baselines. Our suggested model is expected to serve as an aid in improving the efficiency of manual ICD coding and to offer insights for other long text classification tasks with multiple label associations.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
A Hierarchical Method to Automatically Encode Chinese Diagnoses Through Semantic Similarity Estimation

Wenxin Ning,Ming Yu,Runtong Zhang

DOI: https://doi.org/10.1186/s12911-016-0269-4

IF: 3.298

2016-01-01

BMC Medical Informatics and Decision Making

Abstract:Background: The accumulation of medical documents in China has rapidly increased in the past years. We focus on developing a method that automatically performs ICD-10 code assignment to Chinese diagnoses from the electronic medical records to support the medical coding process in Chinese hospitals.Methods: We propose two encoding methods: one that directly determines the desired code (flat method), and one that hierarchically determines the most suitable code until the desired code is obtained (hierarchical method). Both methods are based on instances from the standard diagnostic library, a gold standard dataset in China. For the first time, semantic similarity estimation between Chinese words are applied in the biomedical domain with the successful implementation of knowledge-based and distributional approaches. Characteristics of the Chinese language are considered in implementing distributional semantics. We test our methods against 16,330 coding instances from our partner hospital.Results: The hierarchical method outperforms the flat method in terms of accuracy and time complexity. Representing distributional semantics using Chinese characters can achieve comparable performance to the use of Chinese words. The diagnoses in the test set can be encoded automatically with micro-averaged precision of 92.57 %, recall of 89.63 %, and F-score of 91.08 %. A sharp decrease in encoding performance is observed without semantic similarity estimation.Conclusion: The hierarchical nature of ICD-10 codes can enhance the performance of the automated code assignment. Semantic similarity estimation is demonstrated indispensable in dealing with Chinese medical text. The proposed method can greatly reduce the workload and improve the efficiency of the code assignment process in Chinese hospitals.
Training a Deep Contextualized Language Model for International Classification of Diseases, 10th Revision Classification via Federated Learning: Model Development and Validation Study

Pei-Fu Chen,Tai-Liang He,Sheng-Che Lin,Yuan-Chia Chu,Chen-Tsung Kuo,Feipei Lai,Ssu-Ming Wang,Wan-Xuan Zhu,Kuan-Chih Chen,Lu-Cheng Kuo,Fang-Ming Hung,Yu-Cheng Lin,I-Chang Tsai,Chi-Hao Chiu,Shu-Chih Chang,Chi-Yu Yang

DOI: https://doi.org/10.2196/41342

IF: 3.2

2022-11-10

JMIR Medical Informatics

Abstract:Background The automatic coding of clinical text documents by using the International Classification of Diseases, 10th Revision (ICD-10) can be performed for statistical analyses and reimbursements. With the development of natural language processing models, new transformer architectures with attention mechanisms have outperformed previous models. Although multicenter training may increase a model’s performance and external validity, the privacy of clinical documents should be protected. We used federated learning to train a model with multicenter data, without sharing data per se. Objective This study aims to train a classification model via federated learning for ICD-10 multilabel classification. Methods Text data from discharge notes in electronic medical records were collected from the following three medical centers: Far Eastern Memorial Hospital, National Taiwan University Hospital, and Taipei Veterans General Hospital. After comparing the performance of different variants of bidirectional encoder representations from transformers (BERT), PubMedBERT was chosen for the word embeddings. With regard to preprocessing, the nonalphanumeric characters were retained because the model’s performance decreased after the removal of these characters. To explain the outputs of our model, we added a label attention mechanism to the model architecture. The model was trained with data from each of the three hospitals separately and via federated learning. The models trained via federated learning and the models trained with local data were compared on a testing set that was composed of data from the three hospitals. The micro F1 score was used to evaluate model performance across all 3 centers. Results The F1 scores of PubMedBERT, RoBERTa (Robustly Optimized BERT Pretraining Approach), ClinicalBERT, and BioBERT (BERT for Biomedical Text Mining) were 0.735, 0.692, 0.711, and 0.721, respectively. The F1 score of the model that retained nonalphanumeric characters was 0.8120, whereas the F1 score after removing these characters was 0.7875—a decrease of 0.0245 (3.11%). The F1 scores on the testing set were 0.6142, 0.4472, 0.5353, and 0.2522 for the federated learning, Far Eastern Memorial Hospital, National Taiwan University Hospital, and Taipei Veterans General Hospital models, respectively. The explainable predictions were displayed with highlighted input words via the label attention architecture. Conclusions Federated learning was used to train the ICD-10 classification model on multicenter clinical text while protecting data privacy. The model’s performance was better than that of models that were trained locally.

medical informatics
Comparison of different feature extraction methods for applicable automated ICD coding

Zhao Shuai,Diao Xiaolin,Yuan Jing,Huo Yanni,Cui Meng,Wang Yuxin,Zhao Wei

DOI: https://doi.org/10.1186/s12911-022-01753-5

IF: 3.298

2022-01-12

BMC Medical Informatics and Decision Making

Abstract:Abstract Background Automated ICD coding on medical texts via machine learning has been a hot topic. Related studies from medical field heavily relies on conventional bag-of-words (BoW) as the feature extraction method, and do not commonly use more complicated methods, such as word2vec ( W2V ) and large pretrained models like BERT . This study aimed at uncovering the most effective feature extraction methods for coding models by comparing BoW , W2V and BERT variants. Methods We experimented with a Chinese dataset from Fuwai Hospital, which contains 6947 records and 1532 unique ICD codes, and a public Spanish dataset, which contains 1000 records and 2557 unique ICD codes. We designed coding tasks with different code frequency thresholds (denoted as $$f_s$$ f s ), with a lower threshold indicating a more complex task. Using traditional classifiers, we compared BoW , W2V and BERT variants on accomplishing these coding tasks. Results When $$f_s$$ f s was equal to or greater than 140 for Fuwai dataset, and 60 for the Spanish dataset, the BERT variants with the whole network fine-tuned was the best method, leading to a Micro-F 1 of 93.9% for Fuwai data when $$f_s=200$$ f s = 200 , and a Micro-F 1 of 85.41% for the Spanish dataset when $$f_s=180$$ f s = 180 . When $$f_s$$ f s fell below 140 for Fuwai dataset, and 60 for the Spanish dataset, BoW turned out to be the best, leading to a Micro-F 1 of 83% for Fuwai dataset when $$f_s=20$$ f s = 20 , and a Micro-F 1 of 39.1% for the Spanish dataset when $$f_s=20$$ f s = 20 . Our experiments also showed that both the BERT variants and BoW possessed good interpretability, which is important for medical applications of coding models. Conclusions This study shed light on building promising machine learning models for automated ICD coding by revealing the most effective feature extraction methods. Concretely, our results indicated that fine-tuning the whole network of the BERT variants was the optimal method for tasks covering only frequent codes, especially codes that represented unspecified diseases, while BoW was the best for tasks involving both frequent and infrequent codes. The frequency threshold where the best-performing method varied differed between different datasets due to factors like language and codeset.

medical informatics
Automatic ICD-10 Coding and Training System: Deep Neural Network Based on Supervised Learning

Pei-Fu Chen,Ssu-Ming Wang,Wei-Chih Liao,Lu-Cheng Kuo,Kuan-Chih Chen,Yu-Cheng Lin,Chi-Yu Yang,Chi-Hao Chiu,Shu-Chih Chang,Feipei Lai

DOI: https://doi.org/10.2196/23230

IF: 3.2

2021-08-31

JMIR Medical Informatics

Abstract:Background The International Classification of Diseases (ICD) code is widely used as the reference in medical system and billing purposes. However, classifying diseases into ICD codes still mainly relies on humans reading a large amount of written material as the basis for coding. Coding is both laborious and time-consuming. Since the conversion of ICD-9 to ICD-10, the coding task became much more complicated, and deep learning– and natural language processing–related approaches have been studied to assist disease coders. Objective This paper aims at constructing a deep learning model for ICD-10 coding, where the model is meant to automatically determine the corresponding diagnosis and procedure codes based solely on free-text medical notes to improve accuracy and reduce human effort. Methods We used diagnosis records of the National Taiwan University Hospital as resources and apply natural language processing techniques, including global vectors, word to vectors, embeddings from language models, bidirectional encoder representations from transformers, and single head attention recurrent neural network, on the deep neural network architecture to implement ICD-10 auto-coding. Besides, we introduced the attention mechanism into the classification model to extract the keywords from diagnoses and visualize the coding reference for training freshmen in ICD-10. Sixty discharge notes were randomly selected to examine the change in the F1-score and the coding time by coders before and after using our model. Results In experiments on the medical data set of National Taiwan University Hospital, our prediction results revealed F1-scores of 0.715 and 0.618 for the ICD-10 Clinical Modification code and Procedure Coding System code, respectively, with a bidirectional encoder representations from transformers embedding approach in the Gated Recurrent Unit classification model. The well-trained models were applied on the ICD-10 web service for coding and training to ICD-10 users. With this service, coders can code with the F1-score significantly increased from a median of 0.832 to 0.922 (P<.05), but not in a reduced interval. Conclusions The proposed model significantly improved the F1-score but did not decrease the time consumed in coding by disease coders.

medical informatics
Temporal changes in breast cancer incidence in South Asian women.

A. Stotter,J. Jenkins,M. Edmondson-Jones,H. Blackledge,O. Kearins

DOI: https://doi.org/10.1016/j.canep.2014.08.009

IF: 2.89

2014-12-01

Cancer Epidemiology

Abstract:
A Comparison of Representation Learning Methods for Medical Concepts in MIMIC-IV

Xuan Wu,Yizheng Zhao,Yang Yang,Zhangdaihong Liu,David A. Clifton

DOI: https://doi.org/10.1101/2022.08.21.22278835

2022-01-01

Abstract:Objective To compare and release the diagnosis (ICD-10-CM), procedure (ICD-10-PCS), and medication (NDC) concept (code) embeddings trained by Latent Dirichlet Allocation (LDA), Word2Vec, GloVe, and BERT, for more efficient electronic health record (EHR) data analysis. Materials and Methods The embeddings were pre-trained by the four aforementioned models separately using the diagnosis, procedure, and medication information in MIMIC-IV. We interpreted the embeddings by visualizing them in 2D space and used the silhouette coefficient to assess the clustering ability of these embeddings. Furthermore, we evaluated the embeddings in three downstream tasks without fine-tuning: next visit diagnoses prediction, ICU patients mortality prediction, and medication recommendation. Results We found that embeddings pre-trained by GloVe have the best performance in the downstream tasks and the best interpretability for all diagnosis, procedure, and medication codes. In the next-visit diagnosis prediction, the accuracy of using GloVe embeddings was 12.2% higher than the baseline, which is the random generator. In the other two prediction tasks, GloVe improved the accuracy by 2%-3% over the baseline. LDA, Word2Vec, and BERT marginally improved the results over the baseline in most cases. Discussion and Conclusion GloVe shows superiority in mining diagnoses, procedures, and medications information of MIMIC-IV compared with LDA, Word2Vec, and BERT. Besides, we found that the granularity of training samples can affect the performance of models according to the downstream task and pre-train data. ### Competing Interest Statement The authors have declared no competing interest. ### Funding Statement This study did not receive any funding ### Author Declarations I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained. Yes The details of the IRB/oversight body that provided approval or exemption for the research described are given below: Ethics committee/IRB of National Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China gave ethical approval for this work Ethics committee/IRB of Oxford Suzhou Centre for Advanced Research, Suzhou, China gave ethical approval for this work Ethics committee/IRB of Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX1 2JD, UK gave ethical approval for this work Ethics committee/IRB of Ethics committee/IRB of gave ethical approval for this work I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals. Yes I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance). Yes I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable. Yes All data produced in the present study are available upon reasonable request to the authors <https://bit.ly/3ONj9Su>
Nucleotide sequence of a cDNA clone encoding a rabbit immunoglobulin-lambda light chain: the V lambda region differs markedly from that of other species.

D. J. Hayzer,J. Jaton

DOI: https://doi.org/10.4049/jimmunol.138.7.2316

1987-04-01

Abstract:A cDNA clone (pDH7) has been isolated which encodes the entire leader peptide and variable (V) region and most of the constant (C) region of a rabbit lambda-light chain. Although similar to amino acid sequences derived from fragments of isolated lambda-chains from several Basilea rabbits, differences in the first framework region (FR1) suggest that at least two germ-line V lambda genes are expressed. There are major differences between rabbit V lambda sequences and light chains of other species: in particular, rabbit lambda-chains have an additional four amino acids in the vicinity of the FR2-CDR2 junction. The same region also has significant homology with the human D2 germ-line mini-gene sequence, especially with a 14-nucleotide sequence previously shown to be homologous to human and rabbit heavy chain CDR2 sequences. Similar homologies in other heavy and light chain sequences suggest that D-gene segments may be derived from VH genes, perhaps by transposition. The framework regions of the rabbit lambda-chain encoded by clone pDH7 show the greatest homologies with those of human kappa- and lambda-sequences (46 to 54% homology), with that of chicken sequence (55%), and least with murine V lambda sequences (40%).
Enhancing Automated Medical Coding: Evaluating Embedding Models for ICD-10-CM Code Mapping

vanessa klotzman

DOI: https://doi.org/10.1101/2024.07.02.24309849

2024-07-03

Abstract:Purpose:The goal of this study is to enhance automated medical coding (AMC) by evaluating the effectiveness of modern embedding models in capturing seman- tic similarity and improving the retrieval process for ICD-10-CM code mapping. Achieving consistent and accurate medical coding practices is crucial for effective healthcare management. Methods:We compared the performance of embedding models, including text- embedding-3-large, text-embedding-004, voyage-large-2-instruct, and mistral- embed, against ClinicalBERT. These models were assessed for their ability to capture semantic similarity between long and short ICD-10-CM descriptions and to improve the retrieval process for mapping diagnosis strings from the eICU database to the correct ICD-10-CM codes. Results: The text-embedding-3-large and text-embedding-004 models outper- formed ClinicalBERT in capturing semantic similarity, with text-embedding-3- large achieving the highest accuracy. For ICD-10 code retrieval, the voyage- large-2-instruct model demonstrated the best performance. Using the 15 nearest neighbors provided the best results. Increasing the number beyond this did not improve accuracy due to a lack of meaningful information. Conclusion: Modern embedding models significantly outperform specialized models like ClinicalBERT in AMC tasks. These findings underscore the potential of these models to enhance medical coding practices, in spite of the challenges with ambiguous diagnosis descriptions.

Health Informatics
Regles positionnelles iteratives, principe majoritaire et preferences unimodales

D. Lepelley,L. Vidu

DOI: https://doi.org/10.1051/ro:2000118

2000-07-01

Abstract:Sequential scoring rules are multi-stage social choice tules that work as follows: at each stage of the process, a score is computed for each alternative by taking into account its position in the individual preference rankings, and the alternative with the lowest score is eliminated. The current paper studies the ability of these rules for choosing the Condorcet winner (or the strong Condorcet winner) when individual preferences are single-peaked.
Deep-ADCA: Development and Validation of Deep Learning Model for Automated Diagnosis Code Assignment Using Clinical Notes in Electronic Medical Records

Jakir Hossain Bhuiyan Masud,Chiang Shun,Chen-Cheng Kuo,Mohaimenul Islam,Chih-Yang Yeh,Hsuan-Chia Yang,Ming-Chin Lin,Md. Mohaimenul Islam

DOI: https://doi.org/10.3390/jpm12050707

IF: 3.5083

2022-04-28

Journal of Personalized Medicine

Abstract:Currently, the International Classification of Diseases (ICD) codes are being used to improve clinical, financial, and administrative performance. Inaccurate ICD coding can lower the quality of care, and delay or prevent reimbursement. However, selecting the appropriate ICD code from a patient’s clinical history is time-consuming and requires expert knowledge. The rapid spread of electronic medical records (EMRs) has generated a large amount of clinical data and provides an opportunity to predict ICD codes using deep learning models. The main objective of this study was to use a deep learning-based natural language processing (NLP) model to accurately predict ICD-10 codes, which could help providers to make better clinical decisions and improve their level of service. We retrospectively collected clinical notes from five outpatient departments (OPD) from one university teaching hospital between January 2016 and December 2016. We applied NLP techniques, including global vectors, word to vectors, and embedding techniques to process the data. The dataset was split into two independent training and testing datasets consisting of 90% and 10% of the entire dataset, respectively. A convolutional neural network (CNN) model was developed, and the performance was measured using the precision, recall, and F-score. A total of 21,953 medical records were collected from 5016 patients. The performance of the CNN model for the five different departments was clinically satisfactory (Precision: 0.50~0.69 and recall: 0.78~0.91). However, the CNN model achieved the best performance for the cardiology department, with a precision of 69%, a recall of 89% and an F-score of 78%. The CNN model for predicting ICD-10 codes provides an opportunity to improve the quality of care. Implementing this model in real-world clinical settings could reduce the manual coding workload, enhance the efficiency of clinical coding, and support physicians in making better clinical decisions.

medicine, general & internal,health care sciences & services
Automated ICD coding for primary diagnosis via clinically interpretable machine learning

Xiaolin Diao,Yanni Huo,Shuai Zhao,Jing Yuan,Meng Cui,Yuxin Wang,Xiaodan Lian,Wei Zhao

DOI: https://doi.org/10.1016/j.ijmedinf.2021.104543

IF: 4.73

2021-09-01

International Journal of Medical Informatics

Abstract:BackgroundComputer-assisted clinical coding (CAC) based on automated coding algorithms has been expected to improve the International Classification of Disease, tenth version (ICD-10) coding quality and productivity, whereas studies oriented to primary diagnosis auto-coding are limited in the Chinese context.ObjectiveThis study aims at developing a machine learning (ML) model for automated primary diagnosis ICD-10 coding.MethodsA total of 71709 admissions in Fuwai hospital were included to carry out this study, corresponding to 168 primary diagnosis ICD-10 codes. Based on clinical implications, two feature engineering methods were used to process discharge diagnosis and procedure texts into sequential features and sequential grouping features respectively by which two kinds of models were built and compared. One baseline model using one-hot encoding features was considered. Light Gradient Boosting Machine (LightGBM) was adopted as the classifier, and grid search and cross-validation were used to select the optimal hyperparameters. SHapley Additive exPlanations (SHAP) values were applied to give the interpretability of models.ResultsOur best prediction model was developed based on sequential grouping features. It showed good performance in the test phase with accuracy and macro-averaged F1 (Macro-F1) of 95.2% and 88.3% respectively. The comparison of the models demonstrated the effectiveness of the sequential information and the grouping strategy in boosting model performance (P-value<0.01). Subgroup analysis of the best model on each individual code manifested that 91.1% of the codes achieved the F1 over 70.0%.ConclusionsOur model has been demonstrated its effectiveness for automated primary diagnosis coding in the Chinese context and its results are interpretable. Hence, it has the potential to assist clinical coders to improve coding efficiency and quality in Chinese inpatient settings.

health care sciences & services,computer science, information systems,medical informatics
Interpretable ICD Code Embeddings with Self- and Mutual-Attention Mechanisms

Dixin Luo,Hongteng Xu,Lawrence Carin

DOI: https://doi.org/10.48550/arXiv.1906.05492

2019-06-13

Abstract:We propose a novel and interpretable embedding method to represent the international statistical classification codes of diseases and related health problems (i.e., ICD codes). This method considers a self-attention mechanism within the disease domain and a mutual-attention mechanism jointly between diseases and procedures. This framework captures the clinical relationships between the disease codes and procedures associated with hospital admissions, and it predicts procedures according to diagnosed diseases. A self-attention network is learned to fuse the embeddings of the diseases for each admission. The similarities between the fused disease embedding and the procedure embeddings indicate which procedure should potentially be recommended. Additionally, when learning the embeddings of the ICD codes, the optimal transport between the diseases and the procedures within each admission is calculated as a regularizer of the embeddings. The optimal transport provides a mutual-attention map between diseases and the procedures, which suppresses the ambiguity within their clinical relationships. The proposed method achieves clinically-interpretable embeddings of ICD codes, and outperforms state-of-the-art embedding methods in procedure recommendation.

Applications,Machine Learning
Evaluating a Natural Language Processing–Driven, AI-Assisted International Classification of Diseases, 10th Revision, Clinical Modification, Coding System for Diagnosis Related Groups in a Real Hospital Environment: Algorithm Development and Validation Study

Hong-Jie Dai,Chen-Kai Wang,Chien-Chang Chen,Chong-Sin Liou,An-Tai Lu,Chia-Hsin Lai,Bo-Tsz Shain,Cheng-Rong Ke,William Yu Chung Wang,Tatheer Hussain Mir,Mutiara Simanjuntak,Hao-Yun Kao,Ming-Ju Tsai,Vincent S Tseng

DOI: https://doi.org/10.2196/58278

IF: 7.076

2024-09-20

Journal of Medical Internet Research

Abstract:Background International Classification of Diseases codes are widely used to describe diagnosis information, but manual coding relies heavily on human interpretation, which can be expensive, time consuming, and prone to errors. With the transition from the International Classification of Diseases, Ninth Revision, to the International Classification of Diseases, Tenth Revision (ICD-10), the coding process has become more complex, highlighting the need for automated approaches to enhance coding efficiency and accuracy. Inaccurate coding can result in substantial financial losses for hospitals, and a precise assessment of outcomes generated by a natural language processing (NLP)–driven autocoding system thus assumes a critical role in safeguarding the accuracy of the Taiwan diagnosis related groups (Tw-DRGs). Objective This study aims to evaluate the feasibility of applying an International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), autocoding system that can automatically determine diagnoses and codes based on free-text discharge summaries to facilitate the assessment of Tw-DRGs, specifically principal diagnosis and major diagnostic categories (MDCs). Methods By using the patient discharge summaries from Kaohsiung Medical University Chung-Ho Memorial Hospital (KMUCHH) from April 2019 to December 2020 as a reference data set we developed artificial intelligence (AI)–assisted ICD-10-CM coding systems based on deep learning models. We constructed a web-based user interface for the AI-assisted coding system and deployed the system to the workflow of the certified coding specialists (CCSs) of KMUCHH. The data used for the assessment of Tw-DRGs were manually curated by a CCS with the principal diagnosis and MDC was determined from discharge summaries collected at KMUCHH from February 2023 to April 2023. Results Both the reference data set and real hospital data were used to assess performance in determining ICD-10-CM coding, principal diagnosis, and MDC for Tw-DRGs. Among all methods, the GPT-2 (OpenAI)-based model achieved the highest F1-score, 0.667 (F1-score 0.851 for the top 50 codes), on the KMUCHH test set and a slightly lower F1-score, 0.621, in real hospital data. Cohen κ evaluation for the agreement of MDC between the models and the CCS revealed that the overall average κ value for GPT-2 (κ=0.714) was approximately 12.2 percentage points higher than that of the hierarchy attention network (κ=0.592). GPT-2 demonstrated superior agreement with the CCS across 6 categories of MDC, with an average κ value of approximately 0.869 (SD 0.033), underscoring the effectiveness of the developed AI-assisted coding system in supporting the work of CCSs. Conclusions An NLP-driven AI-assisted coding system can assist CCSs in ICD-10-CM coding by offering coding references via a user interface, demonstrating the potential to reduce the manual workload and expedite Tw-DRG assessment. Consistency in performance affirmed the effectiveness of the system in supporting CCSs in ICD-10-CM coding and the judgment of Tw-DRGs.

health care sciences & services,medical informatics
Enhanced ICD-10 code assignment of clinical texts: A summarization-based approach

Yaoqian Sun,Lei Sang,Dan Wu,Shilin He,Yani Chen,Huilong Duan,Han Chen,Xudong Lu

DOI: https://doi.org/10.1016/j.artmed.2024.102967

2024-08-20

Abstract:Background: Assigning International Classification of Diseases (ICD) codes to clinical texts is a common and crucial practice in patient classification, hospital management, and further statistics analysis. Current auto-coding methods mainly transfer this task to a multi-label classification problem. Such solutions are suffering from high-dimensional mapping space and excessive redundant information in long clinical texts. To alleviate such a situation, we introduce text summarization methods to the ICD coding regime and apply text matching to select ICD codes. Method: We focus on the tenth revision of the ICD (ICD-10) coding and design a novel summarization-based approach (SuM) with an end-to-end strategy to efficiently assign ICD-10 code to clinical texts. In this approach, a knowledge-guided pointer network is purposed to distill and summarize key information in clinical texts precisely. Then a matching model with matching-aggregation architecture follows to align the summary result with code, tuning the one-vs-all scenario to one-vs-one matching so that the large-label-space obstacle laid in classification approaches would be avoided. Result: The 12,788 ICD-10 coded discharge summaries from a Chinese hospital were collected to evaluate the proposed approach. Compared with existing methods, the purposed model achieves the greatest coding results with Micro AUC of 0.9548, MRR@10 of 0.7977, Precision@10 of 0.0944, and Recall@10 of 0.9439 for the TOP-50 Dataset. Results on the FULL-Dataset remain consistent. Also, the proposed knowledge encoder and applied end-to-end strategy are proven to facilitate the whole model to gain efficacy in selecting the most suitable code. Conclusion: The proposed automatic ICD-10 code assignment approach via text summarization can effectively capture critical messages in long clinical texts and improve the performance of ICD-10 coding of clinical texts.
Modelling Temporal Document Sequences for Clinical ICD Coding

Clarence Boon Liang Ng,Diogo Santos,Marek Rei

DOI: https://doi.org/10.48550/arXiv.2302.12666

2023-02-24

Abstract:Past studies on the ICD coding problem focus on predicting clinical codes primarily based on the discharge summary. This covers only a small fraction of the notes generated during each hospital stay and leaves potential for improving performance by analysing all the available clinical notes. We propose a hierarchical transformer architecture that uses text across the entire sequence of clinical notes in each hospital stay for ICD coding, and incorporates embeddings for text metadata such as their position, time, and type of note. While using all clinical notes increases the quantity of data substantially, superconvergence can be used to reduce training costs. We evaluate the model on the MIMIC-III dataset. Our model exceeds the prior state-of-the-art when using only discharge summaries as input, and achieves further performance improvements when all clinical notes are used as input.

Machine Learning,Artificial Intelligence,Computation and Language

Defending the mucosa: adjuvant and carrier formulations for mucosal immunity.

A Hybrid Method for Icd-10 Auto-Coding of Chinese Diagnoses

Automatic International Classification of Diseases Coding System: Deep Contextualized Language Model With Rule-Based Approaches

Automatic ICD-10 coding: Deep semantic matching based on analogical reasoning

Automatic ICD-10 Coding Algorithm Using an Improved Longest Common Subsequence Based on Semantic Similarity

Modelling long medical documents and code associations for explainable automatic ICD coding

A Hierarchical Method to Automatically Encode Chinese Diagnoses Through Semantic Similarity Estimation

Training a Deep Contextualized Language Model for International Classification of Diseases, 10th Revision Classification via Federated Learning: Model Development and Validation Study

Comparison of different feature extraction methods for applicable automated ICD coding

Automatic ICD-10 Coding and Training System: Deep Neural Network Based on Supervised Learning

Temporal changes in breast cancer incidence in South Asian women.

A Comparison of Representation Learning Methods for Medical Concepts in MIMIC-IV

Nucleotide sequence of a cDNA clone encoding a rabbit immunoglobulin-lambda light chain: the V lambda region differs markedly from that of other species.

Enhancing Automated Medical Coding: Evaluating Embedding Models for ICD-10-CM Code Mapping

Regles positionnelles iteratives, principe majoritaire et preferences unimodales

Deep-ADCA: Development and Validation of Deep Learning Model for Automated Diagnosis Code Assignment Using Clinical Notes in Electronic Medical Records

Automated ICD coding for primary diagnosis via clinically interpretable machine learning

Interpretable ICD Code Embeddings with Self- and Mutual-Attention Mechanisms

Evaluating a Natural Language Processing–Driven, AI-Assisted International Classification of Diseases, 10th Revision, Clinical Modification, Coding System for Diagnosis Related Groups in a Real Hospital Environment: Algorithm Development and Validation Study

Enhanced ICD-10 code assignment of clinical texts: A summarization-based approach

Modelling Temporal Document Sequences for Clinical ICD Coding