Abstract:Background:The biomedical literature is the primary information source for manual protein-protein interaction annotations. Text-mining systems have been implemented to extract binary protein interactions from articles, but a comprehensive comparison between the different techniques as well as with manual curation was missing.Results:We designed a community challenge, the BioCreative II protein-protein interaction (PPI) task, based on the main steps of a manual protein interaction annotation workflow. It was structured into four distinct subtasks related to: (a) detection of protein interaction-relevant articles; (b) extraction and normalization of protein interaction pairs; (c) retrieval of the interaction detection methods used; and (d) retrieval of actual text passages that provide evidence for protein interactions. A total of 26 teams submitted runs for at least one of the proposed subtasks. In the interaction article detection subtask, the top scoring team reached an F-score of 0.78. In the interaction pair extraction and mapping to SwissProt, a precision of 0.37 (with recall of 0.33) was obtained. For associating articles with an experimental interaction detection method, an F-score of 0.65 was achieved. As for the retrieval of the PPI passages best summarizing a given protein interaction in full-text articles, 19% of the submissions returned by one of the runs corresponded to curator-selected sentences. Curators extracted only the passages that best summarized a given interaction, implying that many of the automatically extracted ones could contain interaction information but did not correspond to the most informative sentences.Conclusion:The BioCreative II PPI task is the first attempt to compare the performance of text-mining tools specific for each of the basic steps of the PPI extraction pipeline. The challenges identified range from problems in full-text format conversion of articles to difficulties in detecting interactor protein pairs and then linking them to their database records. Some limitations were also encountered when using a single (and possibly incomplete) reference database for protein normalization or when limiting search for interactor proteins to co-occurrence within a single sentence, when a mention might span neighboring sentences. Finally, distinguishing between novel, experimentally verified interactions (annotation relevant) and previously known interactions adds additional complexity to these tasks.

Mining physical protein-protein interactions by exploiting abundant features

Mining physical protein-protein interactions from the literature

Profile-feature Based Protein Interaction Extraction from Full-Text Articles

Protein-protein interaction extraction from bio-literature with compact features and data sampling strategy

Discovering Patterns to Extract Protein-Protein Interactions from Full Texts

Protein-protein interaction networks as miners of biological discovery

Extracting Protein-Protein Interactions (PPIs) from Biomedical Literature using Attention-based Relational Context Information

PPI-Miner: A Structure and Sequence Motif Co-Driven Protein-Protein Interaction Mining and Modeling Computational Method

A hybrid method for extraction of protein-protein interactions from literature

Detecting experimental techniques and selecting relevant documents for protein-protein interactions from biomedical literature

Uncovering protein interaction in abstracts and text using a novel linear model and word proximity networks

Classifying protein-protein interaction articles using word and syntactic features

Automatic Extraction of Protein Interaction in Literature

Advances in Computational Methods for Protein–Protein Interaction Prediction

Overview of the protein-protein interaction annotation extraction task of BioCreative II

Investigation and Prediction of Human Interactome Based on Quantitative Features

Mining hub-based protein complexes in massive biological networks

Predicting Protein Complexes Via the Integration of Multiple Biological Information

Effective Protein-Protein Interaction Exploration with PPIretrieval

Feature Assisted bi-directional LSTM Model for Protein-Protein Interaction Identification from Biomedical Texts

Using Maximum Entropy Model To Extract Protein-Protein Interaction Information From Biomedical Literature