Abstract:BackgroundThe medical subdomain of a clinical note, such as cardiology or neurology, is useful content-derived metadata for developing machine learning downstream applications. To classify the medical subdomain of a note accurately, we have constructed a machine learning-based natural language processing (NLP) pipeline and developed medical subdomain classifiers based on the content of the note.MethodsWe constructed the pipeline using the clinical NLP system, clinical Text Analysis and Knowledge Extraction System (cTAKES), the Unified Medical Language System (UMLS) Metathesaurus, Semantic Network, and learning algorithms to extract features from two datasets — clinical notes from Integrating Data for Analysis, Anonymization, and Sharing (iDASH) data repository (n = 431) and Massachusetts General Hospital (MGH) (n = 91,237), and built medical subdomain classifiers with different combinations of data representation methods and supervised learning algorithms. We evaluated the performance of classifiers and their portability across the two datasets.ResultsThe convolutional recurrent neural network with neural word embeddings trained-medical subdomain classifier yielded the best performance measurement on iDASH and MGH datasets with area under receiver operating characteristic curve (AUC) of 0.975 and 0.991, and F1 scores of 0.845 and 0.870, respectively. Considering better clinical interpretability, linear support vector machine-trained medical subdomain classifier using hybrid bag-of-words and clinically relevant UMLS concepts as the feature representation, with term frequency-inverse document frequency (tf-idf)-weighting, outperformed other shallow learning classifiers on iDASH and MGH datasets with AUC of 0.957 and 0.964, and F1 scores of 0.932 and 0.934 respectively. We trained classifiers on one dataset, applied to the other dataset and yielded the threshold of F1 score of 0.7 in classifiers for half of the medical subdomains we studied.ConclusionOur study shows that a supervised learning-based NLP approach is useful to develop medical subdomain classifiers. The deep learning algorithm with distributed word representation yields better performance yet shallow learning algorithms with the word and concept representation achieves comparable performance with better clinical interpretability. Portable classifiers may also be used across datasets from different institutions.

Applying a Deep Learning-Based Sequence Labeling Approach to Detect Attributes of Medical Concepts in Clinical Text

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

The Automatic Extraction of Temporal Relation from Chinese Narrative Medical Records Using Conditional Random Fields

An Approach for Medical Event Detection in Chinese Clinical Notes of Electronic Health Records

Multi-label Classification for Clinical Text with Feature-level Attention

Medical Text Classification Using Hybrid Deep Learning Models with Multihead Attention

Text Detection and Recognition for Images of Medical Laboratory Reports With a Deep Learning Approach

A Study of Deep Learning Approaches for Medication and Adverse Drug Event Extraction from Clinical Text.

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Multi-label Classification Performance using Deep Learning

Label-aware Double Transfer Learning for Cross-Specialty Medical Named Entity Recognition

MADEx: A System for Detecting Medications, Adverse Drug Events, and Their Relations from Clinical Notes

A Novel Approach Towards Medical Entity Recognition in Chinese Clinical Text.

Exploration of Attention Mechanism-Enhanced Deep Learning Models in the Mining of Medical Textual Data

Medical subdomain classification of clinical notes using a machine learning-based natural language processing approach

Effective Medical Code Prediction via Label Internal Alignment

Applications of BERT Based Sequence Tagging Models on Chinese Medical Text Attributes Extraction

Multilabel classification of medical concepts for patient clinical profile identification

Deep learning for named entity recognition on Chinese electronic medical records: Combining deep transfer learning with multitask bi-directional LSTM RNN