Abstract:Automatic clinical text classification is a natural language processing (NLP) technology that unlocks information embedded in clinical narratives. Machine learning approaches have been shown to be effective for clinical text classification tasks. However, a successful machine learning model usually requires extensive human efforts to create labeled training data and conduct feature engineering. In this study, we propose a clinical text classification paradigm using weak supervision and deep representation to reduce these human efforts. We develop a rule-based NLP algorithm to automatically generate labels for the training data, and then use the pre-trained word embeddings as deep representation features for training machine learning models. Since machine learning is trained on labels generated by the automatic NLP algorithm, this training process is called weak supervision. We evaluat the paradigm effectiveness on two institutional case studies at Mayo Clinic: smoking status classification and proximal femur (hip) fracture classification, and one case study using a public dataset: the i2b2 2006 smoking status classification shared task. We test four widely used machine learning models, namely, Support Vector Machine (SVM), Random Forest (RF), Multilayer Perceptron Neural Networks (MLPNN), and Convolutional Neural Networks (CNN), using this paradigm. Precision, recall, and F1 score are used as metrics to evaluate performance. CNN achieves the best performance in both institutional tasks (F1 score: 0.92 for Mayo Clinic smoking status classification and 0.97 for fracture classification). We show that word embeddings significantly outperform tf-idf and topic modeling features in the paradigm, and that CNN captures additional patterns from the weak supervision compared to the rule-based NLP algorithms. We also observe two drawbacks of the proposed paradigm that CNN is more sensitive to the size of training data, and that the proposed paradigm might not be effective for complex multiclass classification tasks. The proposed clinical text classification paradigm could reduce human efforts of labeled training data creation and feature engineering for applying machine learning to clinical text classification by leveraging weak supervision and deep representation. The experimental experiments have validated the effectiveness of paradigm by two institutional and one shared clinical text classification tasks.

A hybrid medical text classification framework: Integrating attentive rule construction and neural network

Medical Text Classification Using Hybrid Deep Learning Models with Multihead Attention

Regular Expression Based Medical Text Classification Using Constructive Heuristic Approach

Traditional Chinese Medicine Clinical Records Classification Using Knowledge-Powered Document Embedding

An Improved Double Channel Long Short-Term Memory Model for Medical Text Classification

A model of integrating convolution and BiGRU dual-channel mechanism for Chinese medical text classifications

Medical Text Classification System Based on Deep Learning

Learning Regular Expressions for Interpretable Medical Text Classification Using a Pool-based Simulated Annealing and Word-vector Models

Hierarchical Multi-Granularity Attention- Based Hybrid Neural Network for Text Classification.

A Novel Neural Network-Based Method for Medical Text Classification

Clinical text classification with rule-based features and knowledge-guided convolutional neural networks

Hybrid Translation with Classification: Revisiting Rule-Based and Neural Machine Translation

EHR-HGCN: An Enhanced Hybrid Approach for Text Classification Using Heterogeneous Graph Convolutional Networks in Electronic Health Records

A clinical text classification paradigm using weak supervision and deep representation

Performance Analysis of Hybrid Deep Learning Models with Attention Mechanism Positioning and Focal Loss for Text Classification

A BERT-Based Hybrid Short Text Classification Model Incorporating CNN and Attention-Based BiGRU

Medical subdomain classification of clinical notes using a machine learning-based natural language processing approach

A text classification network model combining machine learning and deep learning