Abstract:The rapid growth of clinical text data requires accurate and powerful automated classification methods to support medical decision making and personalized healthcare. The multi-label classification task for clinical texts is designed to assign the most relevant set of labels to each clinical text. However, this task presents two significant challenges: (1) how to accurately extract fine-grained semantic features from complex clinical texts, and (2) how to effectively mitigate the issue of label class imbalance. To overcome these problems, we innovatively propose a novel Multi-label Classification of Imbalanced Clinical Text (MCICIT) model. In order to obtain fine-grained semantic features from clinical texts, we utilize the specialized pre-trained language model BioBERT, tailored for biomedical texts. To tackle the challenge of label class imbalance, we present a Co-occurrence Based and Embeddings with Additional Information Enhanced Graph Convolutional Network (CoEAI-GCN) module. On one hand, we enrich the label content by incorporating additional information to acquire more accurate word embeddings as the feature matrix. On the other hand, we combine the co-occurrence relationship of labels to construct a correlation matrix. Ultimately, label representations are learned through a graph convolutional network. By conducting multi-label classification experiments on two clinical text datasets extracted from real medical systems, our model achieves a 3.2% and 0.5% improvement in F1 scores, respectively, compared to state-of-the-art deep learning models. Additionally, we conduct ablation studies to explore the behaviors of the proposed model. These results together demonstrate that our proposed MCICT effectively enhances the classification performance of imbalanced clinical texts.

Imbalanced Chinese Multi-label Text Classification Based on Alternating Attention

Multi-label Classification: Dealing with Imbalance by Combining Labels

AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classification

Multi-label Text Classification Model Based on Multi-level Constraint Augmentation and Label Association Attention

Research of multi-label text classification based on label attention and correlation networks

Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification

Chinese Short Text Classification with Mutual-Attention Convolutional Neural Networks

Academic Resource Text Level Multi-label Classification based on Attention

Solving Data Imbalance in Text Classification with Constructing Contrastive Samples

HAIN: Multi-label Classification with Hierarchical Attention-based Interaction Network for Multi-turn Dialogue Texts

Hierarchy-Aware and Label Balanced Model for Hierarchical Text Classification

A Label-Specific Attention-Based Network with Regularized Loss for Multi-label Classification

Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distribution

MCICT: Graph convolutional network-based end-to-end model for multi-label classification of imbalanced clinical text

LA-HCN: Label-based Attention for Hierarchical Multi-label TextClassification Neural Network

MsCoa: Multi-Step Co-Attention Model for Multi-Label Classification

Towards Imbalanced Large Scale Multi-label Classification with Partially Annotated Labels

Addressing challenges in multi-label text classification: A joint attention and shared semantic space approach

Substituting Data Annotation with Balanced Updates and Collective Loss in Multi-label Text Classification

CoMAL: Contrastive Active Learning for Multi-Label Text Classification

Rebalancing Multi-Label Class-Incremental Learning