Abstract:BackgroundThe medical subdomain of a clinical note, such as cardiology or neurology, is useful content-derived metadata for developing machine learning downstream applications. To classify the medical subdomain of a note accurately, we have constructed a machine learning-based natural language processing (NLP) pipeline and developed medical subdomain classifiers based on the content of the note.MethodsWe constructed the pipeline using the clinical NLP system, clinical Text Analysis and Knowledge Extraction System (cTAKES), the Unified Medical Language System (UMLS) Metathesaurus, Semantic Network, and learning algorithms to extract features from two datasets — clinical notes from Integrating Data for Analysis, Anonymization, and Sharing (iDASH) data repository (n = 431) and Massachusetts General Hospital (MGH) (n = 91,237), and built medical subdomain classifiers with different combinations of data representation methods and supervised learning algorithms. We evaluated the performance of classifiers and their portability across the two datasets.ResultsThe convolutional recurrent neural network with neural word embeddings trained-medical subdomain classifier yielded the best performance measurement on iDASH and MGH datasets with area under receiver operating characteristic curve (AUC) of 0.975 and 0.991, and F1 scores of 0.845 and 0.870, respectively. Considering better clinical interpretability, linear support vector machine-trained medical subdomain classifier using hybrid bag-of-words and clinically relevant UMLS concepts as the feature representation, with term frequency-inverse document frequency (tf-idf)-weighting, outperformed other shallow learning classifiers on iDASH and MGH datasets with AUC of 0.957 and 0.964, and F1 scores of 0.932 and 0.934 respectively. We trained classifiers on one dataset, applied to the other dataset and yielded the threshold of F1 score of 0.7 in classifiers for half of the medical subdomains we studied.ConclusionOur study shows that a supervised learning-based NLP approach is useful to develop medical subdomain classifiers. The deep learning algorithm with distributed word representation yields better performance yet shallow learning algorithms with the word and concept representation achieves comparable performance with better clinical interpretability. Portable classifiers may also be used across datasets from different institutions.

A Novel and Effective Multi-Class Classification Method for Imbalanced Medical Transcriptions

Class Weights Random Forest Algorithm for Processing Class Imbalanced Medical Data

Addressing Binary Classification over Class Imbalanced Clinical Datasets Using Computationally Intelligent Techniques

A Scalable Workflow to Build Machine Learning Classifiers with Clinician-in-the-Loop to Identify Patients in Specific Diseases

NLP-based clinical text classification and sentiment analyses of complex medical transcripts using transformer model and machine learning classifiers

A Novel Neural Network-Based Method for Medical Text Classification

A novel fitness function in genetic programming for medical data classification

A deep learning approaches and fastai text classification to predict 25 medical diseases from medical speech utterances, transcription and intent

A Novel Hybrid Machine Learning-Based System Using Deep Learning Techniques and Meta-Heuristic Algorithms for Various Medical Datatypes Classification

Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets

A Novel Pre-processing Method for Classification Problems in Medical Intelligent Tasks

A comparative study on deep learning models for text classification of unstructured medical notes with various levels of class imbalance

Seeing The Whole Patient: Using Multi-Label Medical Text Classification Techniques to Enhance Predictions of Medical Codes

Transformers for Multi-label Classification of Medical Text: An Empirical Comparison

A Keyword-Enhanced Approach to Handle Class Imbalance in Clinical Text Classification

Medical Knowledge-Guided Deep Learning for Imbalanced Medical Image Classification

LMFLOSS: A Hybrid Loss For Imbalanced Medical Image Classification

Handling imbalanced medical image data: A deep-learning-based one-class classification approach

Multi-label Classification Performance using Deep Learning

Medical subdomain classification of clinical notes using a machine learning-based natural language processing approach