Abstract:<p>Named entity recognition (NER) of chemicals and drugs is a critical domain of information extraction in biochemical research. NER provides support for text mining in biochemical reactions, including entity relation extraction, attribute extraction, and metabolic response relationship extraction. However, the existence of complex naming characteristics in the biomedical field, such as polysemy and special characters, make the NER task very challenging. Here, we propose a hybrid deep learning approach to improve the recognition accuracy of NER. Specifically, our approach applies the Bidirectional Encoder Representations from Transformers (BERT) model to extract the underlying features of the text, learns a representation of the context of the text through Bi-directional Long Short-Term Memory (BILSTM), and incorporates the multi-head attention (MHATT) mechanism to extract chapter-level features. In this approach, the MHATT mechanism aims to improve the recognition accuracy of abbreviations to efficiently deal with the problem of inconsistency in full-text labels. Moreover, conditional random field (CRF) is used to label sequence tags because this probabilistic method does not need strict independence assumptions and can accommodate arbitrary context information. The experimental evaluation on a publicly-available dataset shows that the proposed hybrid approach achieves the best recognition performance; in particular, it substantially improves performance in recognizing abbreviations, polysemes, and low-frequency entities, compared with the state-of-the-art approaches. For instance, compared with the recognition accuracies for low-frequency entities produced by the BILSTM-CRF algorithm, those produced by the hybrid approach on two entity datasets (MULTIPLE and IDENTIFIER) have been increased by 80% and 21.69%, respectively.</p>

Improving Legal Entity Recognition Using a Hybrid Transformer Model and Semantic Filtering Approach

Transformer-based Entity Legal Form Classification

Boosting court judgment prediction and explanation using legal entities

uOttawa at LegalLens-2024: Transformer-based Classification Experiments

Understand Legal Documents with Contextualized Large Language Models

Leveraging large language models for efficient representation learning for entity resolution

The Law of Large Documents: Understanding the Structure of Legal Contracts Using Visual Cues

Effective entity matching with transformers

Entity-aware Transformers for Entity Search

Legal Transformer Models May Not Always Help

Legal Information Retrieval and Entailment Using Transformer-based Approaches

UMLS-KGI-BERT: Data-Centric Knowledge Integration in Transformers for Biomedical Entity Recognition

BoostER: Leveraging Large Language Models for Enhancing Entity Resolution

Legal Text Recognition Using LSTM-CRF Deep Learning Model

Large Language Models for Judicial Entity Extraction: A Comparative Study

Entity-Assisted Language Models for Identifying Check-worthy Sentences

Demystifying Legalese: An Automated Approach for Summarizing and Analyzing Overlaps in Privacy Policies and Terms of Service

Improving Feature Extraction Using a Hybrid of CNN and LSTM for Entity Identification

Fusion Deep Learning and Machine Learning for Heterogeneous Military Entity Recognition.

A hybrid deep-learning approach for complex biochemical named entity recognition

VANER: Leveraging Large Language Model for Versatile and Adaptive Biomedical Named Entity Recognition