Abstract:BackgroundThe medical subdomain of a clinical note, such as cardiology or neurology, is useful content-derived metadata for developing machine learning downstream applications. To classify the medical subdomain of a note accurately, we have constructed a machine learning-based natural language processing (NLP) pipeline and developed medical subdomain classifiers based on the content of the note.MethodsWe constructed the pipeline using the clinical NLP system, clinical Text Analysis and Knowledge Extraction System (cTAKES), the Unified Medical Language System (UMLS) Metathesaurus, Semantic Network, and learning algorithms to extract features from two datasets — clinical notes from Integrating Data for Analysis, Anonymization, and Sharing (iDASH) data repository (n = 431) and Massachusetts General Hospital (MGH) (n = 91,237), and built medical subdomain classifiers with different combinations of data representation methods and supervised learning algorithms. We evaluated the performance of classifiers and their portability across the two datasets.ResultsThe convolutional recurrent neural network with neural word embeddings trained-medical subdomain classifier yielded the best performance measurement on iDASH and MGH datasets with area under receiver operating characteristic curve (AUC) of 0.975 and 0.991, and F1 scores of 0.845 and 0.870, respectively. Considering better clinical interpretability, linear support vector machine-trained medical subdomain classifier using hybrid bag-of-words and clinically relevant UMLS concepts as the feature representation, with term frequency-inverse document frequency (tf-idf)-weighting, outperformed other shallow learning classifiers on iDASH and MGH datasets with AUC of 0.957 and 0.964, and F1 scores of 0.932 and 0.934 respectively. We trained classifiers on one dataset, applied to the other dataset and yielded the threshold of F1 score of 0.7 in classifiers for half of the medical subdomains we studied.ConclusionOur study shows that a supervised learning-based NLP approach is useful to develop medical subdomain classifiers. The deep learning algorithm with distributed word representation yields better performance yet shallow learning algorithms with the word and concept representation achieves comparable performance with better clinical interpretability. Portable classifiers may also be used across datasets from different institutions.

A Combined Classification Model for Chinese Clinical Notes

Traditional Chinese Medicine Clinical Records Classification Using Knowledge-Powered Document Embedding

Cross-Domain Learning Based Traditional Chinese Medicine Medical Record Classification.

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

A Novel Approach Towards Medical Entity Recognition in Chinese Clinical Text.

A comprehensive study of named entity recognition in Chinese clinical text

Application of Machine Learning Techniques for Clinical Predictive Modeling: A Cross-Sectional Study on Nonalcoholic Fatty Liver Disease in China

A Natural Language Processing Tool to Extract Quantitative Smoking Status from Clinical Narratives.

Using Natural Language Processing to Extract Clinically Useful Information from Chinese Electronic Medical Records

Traditional Chinese medicine clinical records classification with BERT and domain specific corpora

Medical subdomain classification of clinical notes using a machine learning-based natural language processing approach

An Approach for Medical Event Detection in Chinese Clinical Notes of Electronic Health Records

Classifying early infant feeding status from clinical notes using natural language processing and machine learning

Extracting Important Information From Chinese Operation Notes With Natural Language Processing Methods

An Ensemble Learning Based Framework for Traditional Chinese Medicine Data Analysis with ICD-10 Labels

A query interface for clinical research with Chinese electronic health record using Natural Language Processing

Natural language processing and machine learning to enable automatic extraction and classification of patients’ smoking status from electronic medical records

A unified framework of medical information annotation and extraction for Chinese clinical text

A Hybrid Machine Learning Method for the De-identification of Un-Structured Narrative Clinical Text in Multi-center Chinese Electronic Medical Records Data

Utilizing Chinese Admission Records for MACE Prediction of Acute Coronary Syndrome

Understanding traditional Chinese medicine via statistical learning of expert-specific Electronic Medical Records