Abstract:Automatic clinical text classification is a natural language processing (NLP) technology that unlocks information embedded in clinical narratives. Machine learning approaches have been shown to be effective for clinical text classification tasks. However, a successful machine learning model usually requires extensive human efforts to create labeled training data and conduct feature engineering. In this study, we propose a clinical text classification paradigm using weak supervision and deep representation to reduce these human efforts. We develop a rule-based NLP algorithm to automatically generate labels for the training data, and then use the pre-trained word embeddings as deep representation features for training machine learning models. Since machine learning is trained on labels generated by the automatic NLP algorithm, this training process is called weak supervision. We evaluat the paradigm effectiveness on two institutional case studies at Mayo Clinic: smoking status classification and proximal femur (hip) fracture classification, and one case study using a public dataset: the i2b2 2006 smoking status classification shared task. We test four widely used machine learning models, namely, Support Vector Machine (SVM), Random Forest (RF), Multilayer Perceptron Neural Networks (MLPNN), and Convolutional Neural Networks (CNN), using this paradigm. Precision, recall, and F1 score are used as metrics to evaluate performance. CNN achieves the best performance in both institutional tasks (F1 score: 0.92 for Mayo Clinic smoking status classification and 0.97 for fracture classification). We show that word embeddings significantly outperform tf-idf and topic modeling features in the paradigm, and that CNN captures additional patterns from the weak supervision compared to the rule-based NLP algorithms. We also observe two drawbacks of the proposed paradigm that CNN is more sensitive to the size of training data, and that the proposed paradigm might not be effective for complex multiclass classification tasks. The proposed clinical text classification paradigm could reduce human efforts of labeled training data creation and feature engineering for applying machine learning to clinical text classification by leveraging weak supervision and deep representation. The experimental experiments have validated the effectiveness of paradigm by two institutional and one shared clinical text classification tasks.

A novel medical text classification model with Kalman filter for clinical decision making

A hybrid medical text classification framework: Integrating attentive rule construction and neural network

AliFuse: Aligning and Fusing Multi-modal Medical Data for Computer-Aided Diagnosis

A Clinical Decision Support Framework for Heterogeneous Data Sources

Optimal deep learning based fusion model for biomedical image classification

An Improved Double Channel Long Short-Term Memory Model for Medical Text Classification

medIKAL: Integrating Knowledge Graphs as Assistants of LLMs for Enhanced Clinical Diagnosis on EMRs

DeAF: A Multimodal Deep Learning Framework for Disease Prediction

A clinical text classification paradigm using weak supervision and deep representation

Combining the External Medical Knowledge Graph Embedding to Improve the Performance of Syndrome Differentiation Model

Multimodal Data Hybrid Fusion and Natural Language Processing for Clinical Prediction Models

FLCMC: Federated Learning Approach for Chinese Medicinal Text Classification

Medical Text Classification Using Hybrid Deep Learning Models with Multihead Attention

Double-target self-supervised clustering with multi-feature fusion for medical question texts

A Novel Hybrid Machine Learning-Based System Using Deep Learning Techniques and Meta-Heuristic Algorithms for Various Medical Datatypes Classification

Multi-label Classification for Clinical Text with Feature-level Attention

A hierarchical fusion framework to integrate homogeneous and heterogeneous classifiers for medical decision-making

A Syntactic Information-Based Classification Model for Medical Literature: Algorithm Development and Validation Study

ChatDoctor: A Medical Chat Model Fine-tuned on LLaMA Model using Medical Domain Knowledge

FR–KDE: A Hybrid Fuzzy Rule-Based Information Fusion Method with its Application in Biomedical Classification