Abstract:Background: Abbreviations are considered an essential part of the clinical narrative; they are used not only to save time and space but also to hide serious or incurable illnesses. Misreckoning interpretation of the clinical abbreviations could affect different aspects concerning patients themselves or other services like clinical support systems. There is no consensus in the scientific community to create new abbreviations, making it difficult to understand them. Disambiguate clinical abbreviations aim to predict the exact meaning of the abbreviation based on context, a crucial step in understanding clinical notes. Objectives: Disambiguating clinical abbreviations is an essential task in information extraction from medical texts. Deep contextualized representations models showed promising results in most word sense disambiguation tasks. In this work, we propose a one-fits-all classifier to disambiguate clinical abbreviations with deep contextualized representation from pretrained language models like Bidirectional Encoder Representation from Transformers (BERT). Methods: A set of experiments with different pretrained clinical BERT models were performed to investigate fine-tuning methods on the disambiguation of clinical abbreviations. One-fits-all classifiers were used to improve disambiguating rare clinical abbreviations. Results: One-fits-all classifiers with deep contextualized representations from Bioclinical, BlueBERT, and MS_BERT pretrained models improved the accuracy using the University of Minnesota data set. The model achieved 98.99, 98.75, and 99.13%, respectively. All the models outperform the state-of-the-art in the previous work of around 98.39%, with the best accuracy using the MS_BERT model. Conclusion: Deep contextualized representations via fine-tuning of pretrained language modeling proved its sufficiency on disambiguating clinical abbreviations; it could be robust for rare and unseen abbreviations and has the advantage of avoiding building a separate classifier for each abbreviation. Transfer learning can improve the development of practical abbreviation disambiguation systems.

Acronym Identification Based on SpanBERT-CRF

Abbreviation Expansion Interpretation Recognition Based on Semi-supervised CRF

Learning Conditional Random Fields with Latent Sparse Features for Acronym Expansion Finding

Fine-grained Acronym Expansion Identification Using Latent-State Neural Structured Prediction Model.

Acronym Extraction with Hybrid Strategies.

Expansion Finding For Given Acronyms Using Conditional Random Fields

An Ensemble Approach to Acronym Extraction using Transformers

CABACE: Injecting Character Sequence Information and Domain Knowledge for Enhanced Acronym and Long-Form Extraction

Multi-granularity sequence labeling model for acronym expansion identification

SpanBERT: Improving Pre-training by Representing and Predicting Spans

Domain Adaptive Pretraining for Multilingual Acronym Extraction

LB-BMBC: MHBiaffine-CNN to Capture Span Scores with BERT Injected with Lexical Information for Chinese NER

SimCLAD: A Simple Framework for Contrastive Learning of Acronym Disambiguation

ContextAD: Context-Aware Acronym Disambiguation with Siamese BERT Network

Disambiguating Clinical Abbreviations Using a One-Fits-All Classifier Based on Deep Learning Techniques

Acronym Disambiguation Using Word Embedding.

Dealing With Acronyms In Biomedical Texts

A Machine Learning Approach To Recognizing Acronyms And Their Expansion

Acronym extraction and disambiguation in large-scale organizational web pages.

SEPT: Improving Scientific Named Entity Recognition with Span Representation

BERT Named Entity Recognition with Self-attention Mechanism