Abstract:BackgroundThe medical subdomain of a clinical note, such as cardiology or neurology, is useful content-derived metadata for developing machine learning downstream applications. To classify the medical subdomain of a note accurately, we have constructed a machine learning-based natural language processing (NLP) pipeline and developed medical subdomain classifiers based on the content of the note.MethodsWe constructed the pipeline using the clinical NLP system, clinical Text Analysis and Knowledge Extraction System (cTAKES), the Unified Medical Language System (UMLS) Metathesaurus, Semantic Network, and learning algorithms to extract features from two datasets — clinical notes from Integrating Data for Analysis, Anonymization, and Sharing (iDASH) data repository (n = 431) and Massachusetts General Hospital (MGH) (n = 91,237), and built medical subdomain classifiers with different combinations of data representation methods and supervised learning algorithms. We evaluated the performance of classifiers and their portability across the two datasets.ResultsThe convolutional recurrent neural network with neural word embeddings trained-medical subdomain classifier yielded the best performance measurement on iDASH and MGH datasets with area under receiver operating characteristic curve (AUC) of 0.975 and 0.991, and F1 scores of 0.845 and 0.870, respectively. Considering better clinical interpretability, linear support vector machine-trained medical subdomain classifier using hybrid bag-of-words and clinically relevant UMLS concepts as the feature representation, with term frequency-inverse document frequency (tf-idf)-weighting, outperformed other shallow learning classifiers on iDASH and MGH datasets with AUC of 0.957 and 0.964, and F1 scores of 0.932 and 0.934 respectively. We trained classifiers on one dataset, applied to the other dataset and yielded the threshold of F1 score of 0.7 in classifiers for half of the medical subdomains we studied.ConclusionOur study shows that a supervised learning-based NLP approach is useful to develop medical subdomain classifiers. The deep learning algorithm with distributed word representation yields better performance yet shallow learning algorithms with the word and concept representation achieves comparable performance with better clinical interpretability. Portable classifiers may also be used across datasets from different institutions.

Processing of clinical notes for efficient diagnosis with feedback attention-based BiLSTM

Natural language processing of MIMIC-III clinical notes for identifying diagnosis and procedures with neural networks

Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT

Attention-Based LSTM Network for COVID-19 Clinical Trial Parsing

An Analysis of Attention over Clinical Notes for Predictive Tasks

Contextual classification of clinical records with bidirectional long short‐term memory (Bi‐LSTM) and bidirectional encoder representations from transformers (BERT) model

Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration

Enhancing Early Detection of Cognitive Decline in the Elderly: A Comparative Study Utilizing Large Language Models in Clinical Notes

Automated Scoring of Clinical Patient Notes using Advanced NLP and Pseudo Labeling

Multi-label natural language processing to identify diagnosis and procedure codes from MIMIC-III inpatient notes

Comparative Analysis of a Large Language Model and Machine Learning Method for Prediction of Hospitalization from Nurse Triage Notes: Implications for Machine Learning-based Resource Management

Improving clinical abbreviation sense disambiguation using attention‐based Bi‐LSTM and hybrid balancing techniques in imbalanced datasets

Multimodal temporal-clinical note network for mortality prediction

Deep EHR: Chronic Disease Prediction Using Medical Notes

FineEHR: Refine Clinical Note Representations to Improve Mortality Prediction

Explainable Prediction of Adverse Outcomes Using Clinical Notes

Dementia risk prediction using decision-focused content selection from medical notes

A Scalable Workflow to Build Machine Learning Classifiers with Clinician-in-the-Loop to Identify Patients in Specific Diseases

Medical subdomain classification of clinical notes using a machine learning-based natural language processing approach

How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling