Abstract:Biomedical Named Entity Recognition (NER) is a fundamental task of Biomedical Natural Language Processing for extracting relevant information from biomedical texts, such as clinical records, scientific publications, and electronic health records. The conventional approaches for biomedical NER mainly use traditional machine learning techniques, such as Conditional Random Fields and Support Vector Machines or deep learning-based models like Recurrent Neural Networks and Convolutional Neural Networks. Recently, Transformer-based models, including BERT, have been used in the domain of biomedical NER and have demonstrated remarkable results. However, these models are often based on word-level embeddings, limiting their ability to capture character-level information, which is effective in biomedical NER due to the high variability and complexity of biomedical texts. To address these limitations, this paper proposes a hybrid approach that integrates the strengths of multiple models. In this paper, we proposed an approach that leverages fine-tuned BERT to provide contextualized word embeddings, a pre-trained multi-channel CNN for character-level information capture, and following by a BiLSTM + CRF for sequence labelling and modelling dependencies between the words in the text. In addition, also we propose an enhanced labelling method as part of pre-processing to enhance the identification of the entity's beginning word and thus improve the identification of multi-word entities, a common challenge in biomedical NER. By integrating these models and the pre-processing method, our proposed model effectively captures both contextual information and detailed character-level information. We evaluated our model on the benchmark i2b2/2010 dataset, achieving an F1-score of 90.11. These results illustrate the proficiency of our proposed model in performing biomedical Named Entity Recognition.

Boosting Arabic Named-Entity Recognition With Multi-Attention Layer.

Bidirectional Encoder–Decoder Model for Arabic Named Entity Recognition

BE-BLC: BERT-ELMO-Based Deep Neural Network Architecture for English Named Entity Recognition Task

Classical Arabic Named Entity Recognition Using Variant Deep Neural Network Architectures and BERT

Weak Supervision Approach for Arabic Named Entity Recognition

Improving Arabic sentiment analysis across context-aware attention deep model based on natural language processing

Neural Named Entity Recognition from Subword Units

Using LSTM and GRU With a New Dataset for Named Entity Recognition in the Arabic Language

mucAI at WojoodNER 2024: Arabic Named Entity Recognition with Nearest Neighbor Search

Enriching Urdu NER with BERT Embedding, Data Augmentation, and Hybrid Encoder-CNN Architecture

Multi-Grained Named Entity Recognition

Focusing on Potential Named Entities During Active Label Acquisition

Multi-level biomedical NER through multi-granularity embeddings and enhanced labeling

A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

Composited-Nested-Learning with Data Augmentation for Nested Named Entity Recognition

Improving Feature Extraction Using a Hybrid of CNN and LSTM for Entity Identification

Hero-Gang Neural Model For Named Entity Recognition

Incorporating Entity Type-Aware and Word–Word Relation-Aware Attention in Generative Named Entity Recognition

A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition

Named Entity Recognition Based on Pre-training Model and Multi-head Attention Mechanism