Abstract:Procedural coding presents a taxing challenge for clinicians. However, recent advances in natural language processing offer a promising avenue for developing applications that assist clinicians, thereby alleviating their administrative burdens. This study seeks to create an application capable of predicting procedure codes by analysing clinicians' operative notes, aiming to streamline their workflow and enhance efficiency. We downstreamed an existing and a native German medical BERT model in a secondary use scenario, utilizing already coded surgery notes to model the coding procedure as a multi-label classification task. In comparison to the transformer-based architecture, we were levering the non-contextual model fastText, a convolutional neural network, a support vector machine and logistic regression for a comparative analysis of possible coding performance. About 350,000 notes were used for model adaption. By considering the top five suggested procedure codes from medBERT.de, surgeryBERT.at, fastText, a convolutional neural network, a support vector machine and a logistic regression, the mean average precision achieved was 0.880, 0.867, 0.870, 0.851, 0.870 and 0.805 respectively. Support vector machines performed better for surgery reports with a sequence length greater than 512, achieving a mean average precision of 0.872 in comparison to 0.840 for fastText, 0.837 for medBERT.de and 0.820 for surgeryBERT.at. A prototypical front-end application for coding support was additionally implemented. The problem of predicting procedure codes from a given operative report can be successfully modelled as a multi-label classification task, with a promising performance. Support vector machines as a classical machine learning method outperformed the non-contextual fastText approach. FastText with less demanding hardware resources has reached a similar performance to BERT-based models and has shown to be more suitable for explaining the predictions efficiently.

Seeing The Whole Patient: Using Multi-Label Medical Text Classification Techniques to Enhance Predictions of Medical Codes

Traditional Chinese Medicine Clinical Records Classification Using Knowledge-Powered Document Embedding

Transformers for Multi-label Classification of Medical Text: An Empirical Comparison

Multi-label Classification Performance using Deep Learning

Applicability of Machine Learning Methods to Multi-label Medical Text Classification

Using text embedding models as text classifiers with medical data

Multi-label text classification via secondary use of large clinical real-world data sets

Multi-label Classification for Clinical Text with Feature-level Attention

Improving Predictions of Tail-end Labels using Concatenated BioMed-Transformers for Long Medical Documents

Hybrid Multi-Label Classification Model for Medical Applications Based on Adaptive Synthetic Data and Ensemble Learning

Efficient Classification of Hallmark of Cancer Using Embedding-Based Support Vector Machine for Multilabel Text

Clinical multi-label free text classification by exploiting disease label relation

Exemplar Auditing for Multi-Label Biomedical Text Classification

Multi‑label classification of biomedical data

Multilabel classification of medical concepts for patient clinical profile identification

Effective Medical Code Prediction via Label Internal Alignment

Multi-label natural language processing to identify diagnosis and procedure codes from MIMIC-III inpatient notes

Medical Text Classification Using Hybrid Deep Learning Models with Multihead Attention

Boosting ICD multi-label classification of health records with contextual embeddings and label-granularity

KMTLabeler: an Interactive Knowledge-Assisted Labeling Tool for Medical Text Classification