Abstract:Medicinal chemistry patents contain rich information about chemical compounds. Although much effort has been devoted to extracting chemical entities from scientific literature, limited numbers of patent mining systems are publically available, probably due to the lack of large manually annotated corpora. To accelerate the development of information extraction systems for medicinal chemistry patents, the 2015 BioCreative V challenge organized a track on Chemical and Drug Named Entity Recognition from patent text (CHEMDNER patents). This track included three individual subtasks: (i) Chemical Entity Mention Recognition in Patents (CEMP), (ii) Chemical Passage Detection (CPD) and (iii) Gene and Protein Related Object task (GPRO). We participated in the two subtasks of CEMP and CPD using machine learning-based systems. Our machine learning-based systems employed the algorithms of conditional random fields (CRF) and structured support vector machines (SSVMs), respectively. To improve the performance of the NER systems, two strategies were proposed for feature engineering: (i) domain knowledge features of dictionaries, chemical structural patterns and semantic type information present in the context of the candidate chemical and (ii) unsupervised feature learning algorithms to generate word representation features by Brown clustering and a novel binarized Word embedding to enhance the generalizability of the system. Further, the system output for the CPD task was yielded based on the patent titles and abstracts with chemicals recognized in the CEMP task.The effects of the proposed feature strategies on both the machine learning-based systems were investigated. Our best system achieved the second best performance among 21 participating teams in CEMP with a precision of 87.18%, a recall of 90.78% and aF-measure of 88.94% and was the top performing system among nine participating teams in CPD with a sensitivity of 98.60%, a specificity of 87.21%, an accuracy of 94.75%, a Matthew's correlation coefficient (MCC) of 88.24%, a precision at full recall (P_full_R) of 66.57% and an area under the precision-recall curve (AUC_PR) of 0.9347. The SSVM-based CEMP systems outperformed the CRF-based CEMP systems when using the same features. Features generated from both the domain knowledge and unsupervised learning algorithms significantly improved the chemical NER task on patents.Database URL:http:// database. oxfordjournals. org/ content/ 2016/ baw049.

Transfer Learning for Scientific Data Chain Extraction in Small Chemical Corpus with BERT-CRF Model

Using pretraining and text mining methods to automatically extract the chemical scientific data

A chemical reaction entity recognition method based on a natural language data augmentation strategy

A hybrid deep-learning approach for complex biochemical named entity recognition

Do syntactic trees enhance Bidirectional Encoder Representations from Transformers (BERT) models for chemical–drug relation extraction?

Experiments on transfer learning architectures for biomedical relation extraction

Named entity recognition in chemical patents using ensemble of contextual language models

Chemical named entity recognition in patents by domain knowledge and unsupervised feature learning

BERT Learns (and Teaches) Chemistry

Chem-FINESE: Validating Fine-Grained Few-shot Entity Extraction through Text Reconstruction

BioBERT-based Deep Learning and Merged ChemProt-DrugProt for Enhanced Biomedical Relation Extraction

Chemical Identification and Indexing in PubMed Articles via BERT and Text-to-Text Approaches

Improving Biomedical Named Entity Recognition with Label Re-correction and Knowledge Distillation

Development of Biomedical Corpus Enlargement Platform Using BERT for Bio-entity Recognition

Transfer learning for biomedical named entity recognition with neural networks

A Large Encoder-Decoder Family of Foundation Models For Chemical Language

Predictive Chemistry Augmented with Text Retrieval

From Tokenization to Self-Supervision: Building a High-Performance Information Extraction System for Chemical Reactions in Patents

Partial Annotation Learning for Biomedical Entity Recognition

Improving Chemical Named Entity Recognition in Patents with Contextualized Word Embeddings

BERT-BIGRU-CRF: A Novel Entity Relationship Extraction Model