Abstract:Motivation: The explosive increase of biomedical literature has made information extraction an increasingly important tool for biomedical research. A fundamental task is the recognition of biomedical named entities in text (BNER) such as genes/proteins, diseases and species. Recently, a domain-independent method based on deep learning and statistical word embeddings, called long short-term memory network-conditional random field (LSTM-CRF), has been shown to outperform state-of-the-art entity-specific BNER tools. However, this method is dependent on gold-standard corpora (GSCs) consisting of hand-labeled entities, which tend to be small but highly reliable. An alternative to GSCs are silver-standard corpora (SSCs), which are generated by harmonizing the annotations made by several automatic annotation systems. SSCs typically contain more noise than GSCs but have the advantage of containing many more training examples. Ideally, these corpora could be combined to achieve the benefits of both, which is an opportunity for transfer learning. In this work, we analyze to what extent transfer learning improves upon state-of-the-art results for BNER.Results: We demonstrate that transferring a deep neural network (DNN) trained on a large, noisy SSC to a smaller, but more reliable GSC significantly improves upon state-of-the-art results for BNER. Compared to a state-of-the-art baseline evaluated on 23 GSCs covering four different entity classes, transfer learning results in an average reduction in error of approximately 11%. We found transfer learning to be especially beneficial for target datasets with a small number of labels (approximately 6000 or less).Availability and implementation: Source code for the LSTM-CRF is available at https://github.com/Franck-Dernoncourt/NeuroNER/ and links to the corpora are available at https://github.com/BaderLab/Transfer-Learning-BNER-Bioinformatics-2018/.Supplementary information: Supplementary data are available at Bioinformatics online.

Identifying nucleotide-binding leucine-rich repeat receptor and pathogen effector pairing using transfer-learning and bilinear attention network

A Hybrid Prediction Method for Plant lncRNA-Protein Interaction.

Disease Named Entity Recognition from Biomedical Literature Using a Novel Convolutional Neural Network

Protein-peptide binding residue prediction based on protein language models and cross-attention mechanism

NCBRPred: predicting nucleic acid binding residues in proteins based on multilabel learning

Deep learning facilitates precise identification of disease-resistance genes in plants

Bgfe: A Deep Learning Model For Ncrna-Protein Interaction Predictions Based On Improved Sequence Information

NeuroPred-CLQ: incorporating deep temporal convolutional networks and multi-head attention mechanism to predict neuropeptides

ABLNCPP: Attention Mechanism-Based Bidirectional Long Short-Term Memory for Noncoding RNA Coding Potential Prediction

A deep learning framework to predict binding preference of RNA constituents on protein surface

DPB-NBFnet: Using Neural Bellman-Ford Networks to Predict DNA-protein Binding.

CPGL: Prediction of Compound-Protein Interaction by Integrating Graph Attention Network With Long Short-Term Memory Neural Network

MAHyNet: Parallel Hybrid Network for RNA-Protein Binding Sites Prediction Based on Multi-Head Attention and Expectation Pooling

EDLMFC: an ensemble deep learning framework with multi-scale features combination for ncRNA–protein interaction prediction

NeuroPred-FRL: an interpretable prediction model for identifying neuropeptide using feature representation learning

NeuroPred-PLM: an interpretable and robust model for neuropeptide prediction by protein language model

De Novo Prediction of RNA-protein Interactions from Sequence Information.

ProLanGO: Protein Function Prediction Using Neural Machine Translation Based on a Recurrent Neural Network

Predicting Protein-Peptide Binding Residues Via Interpretable Deep Learning.

Transfer learning for biomedical named entity recognition with neural networks

Cross-species prediction of transcription factor binding by adversarial training of a novel nucleotide-level deep neural network