Abstract:MOTIVATION: Text mining is increasingly used to manage the accelerating pace of the biomedical literature. Many text mining applications depend on accurate named entity recognition (NER) and normalization (grounding). While high performing machine learning methods trainable for many entity types exist for NER, normalization methods are usually specialized to a single entity type. NER and normalization systems are also typically used in a serial pipeline, causing cascading errors and limiting the ability of the NER system to directly exploit the lexical information provided by the normalization.METHODS: We propose the first machine learning model for joint NER and normalization during both training and prediction. The model is trainable for arbitrary entity types and consists of a semi-Markov structured linear classifier, with a rich feature approach for NER and supervised semantic indexing for normalization. We also introduce TaggerOne, a Java implementation of our model as a general toolkit for joint NER and normalization. TaggerOne is not specific to any entity type, requiring only annotated training data and a corresponding lexicon, and has been optimized for high throughput.RESULTS: We validated TaggerOne with multiple gold-standard corpora containing both mention- and concept-level annotations. Benchmarking results show that TaggerOne achieves high performance on diseases (NCBI Disease corpus, NER f-score: 0.829, normalization f-score: 0.807) and chemicals (BioCreative 5 CDR corpus, NER f-score: 0.914, normalization f-score 0.895). These results compare favorably to the previous state of the art, notwithstanding the greater flexibility of the model. We conclude that jointly modeling NER and normalization greatly improves performance.AVAILABILITY AND IMPLEMENTATION: The TaggerOne source code and an online demonstration are available at: http://www.ncbi.nlm.nih.gov/bionlp/taggeroneCONTACT: zhiyong.lu@nih.govSUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

A Transition-based Model for Joint Segmentation, POS-tagging and Normalization

Joint Segmentation and Tagging with Coupled Sequences Labeling

A Unified Model for Joint Chinese Word Segmentation and POS Tagging with Heterogeneous Annotation Corpora.

Incorporating External POS Tagger for Punctuation Restoration

Joint Chinese Word Segmentation and POS Tagging on Heterogeneous Annotated Corpora with Multiple Task Learning.

Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks

A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing

Joint POS Tagging and Dependence Parsing With Transition-Based Neural Networks

A Unified Model for Joint Chinese Word Segmentation and Dependency Parsing

Study on Japanese Word Segmentation and POS Tagging Based on Rules and Statistics

A neural joint model for Vietnamese word segmentation, POS tagging and dependency parsing

Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-stage Span Labeling

Improving Chinese Word Segmentation on Micro-blog Using Rich Punctuations.

Joint Training and Decoding Using Virtual Nodes for Cascaded Segmentation and Tagging Tasks.

Word Segmentation of Micro Blogs with Bagging.

A joint method for Chinese word segmentation and part-of-speech labeling based on deep neural network

A Stacked Sub-Word Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging.

Combine CRF and MMSEG to Boost Chinese Word Segmentation in Social Media

Overview of the NLPCC 2015 Shared Task: Chinese Word Segmentation and POS Tagging for Micro-blog Texts

TaggerOne: joint named entity recognition and normalization with semi-Markov Models

Integrated Chinese Segmentation, Parsing and Named Entity Recognition