Abstract:Background: The selection of relevant articles for curation, and linking those articles to experimental techniques confirming the findings became one of the primary subjects of the recent BioCreative III contest. The contest's Protein-Protein Interaction (PPI) task consisted of two sub-tasks: Article Classification Task (ACT) and Interaction Method Task (IMT). ACT aimed to automatically select relevant documents for PPI curation, whereas the goal of IMT was to recognise the methods used in experiments for identifying the interactions in full-text articles. Results: We proposed and compared several classification-based methods for both tasks, employing rich contextual features as well as features extracted from external knowledge sources. For IMT, a new method that classifies pair-wise relations between every text phrase and candidate interaction method obtained promising results with an F1 score of 64.49%, as tested on the task's development dataset. We also explored ways to combine this new approach and more conventional, multi-label document classification methods. For ACT, our classifiers exploited automatically detected named entities and other linguistic information. The evaluation results on the BioCreative III PPI test datasets showed that our systems were very competitive: one of our IMT methods yielded the best performance among all participants, as measured by F1 score, Matthew's Correlation Coefficient and AUC iP/R; whereas for ACT, our best classifier was ranked second as measured by AUC iP/R, and also competitive according to other metrics. Conclusions: Our novel approach that converts the multi-class, multi-label classification problem to a binary classification problem showed much promise in IMT. Nevertheless, on the test dataset the best performance was achieved by taking the union of the output of this method and that of a multi-class, multi-label document classifier, which indicates that the two types of systems complement each other in terms of recall. For ACT, our system exploited a rich set of features and also obtained encouraging results. We examined the features with respect to their contributions to the classification results, and concluded that contextual words surrounding named entities, as well as the MeSH headings associated with the documents were among the main contributors to the performance.

Active Learning Algorithm for Threshold of Decision Probability on Imbalanced Text Classification Based on Protein-Protein Interaction Documents

Positive and Unlabeled Learning through Negative Selection and Imbalance-aware Classification

Protein classification with imbalanced data.

Deep Learning Frameworks for Protein–protein Interaction Prediction

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Active Learning for Protein Function Prediction in Protein-Protein Interaction Networks

GHOST: Adjusting the Decision Threshold to Handle Imbalanced Data in Machine Learning

A Threshold-free Classification Mechanism in Genetic Programming for High-dimensional Unbalanced Classification.

Imbalance Data Processing Strategy for Protein Interaction Sites Prediction

Developing Computational Model to Predict Protein-Protein Interaction Sites Based on the XGBoost Algorithm

Dealing with Class Imbalance using Thresholding

Addressing the class imbalance in tabular datasets from a generative adversarial network approach in supervised machine learning

Imbalanced data classification: A KNN and generative adversarial networks-based hybrid approach for intrusion detection

A hybrid ensemble and evolutionary algorithm for imbalanced classification and its application on bioinformatics

Detecting experimental techniques and selecting relevant documents for protein-protein interactions from biomedical literature

Graph-Based Bidirectional Transformer Decision Threshold Adjustment Algorithm for Class-Imbalanced Molecular Data

Improving protein-protein interactions prediction accuracy using XGBoost feature selection and stacked ensemble classifier

Detecting representative data and generating synthetic samples to improve learning accuracy with imbalanced data sets

Adaptive Sampling With Optimal Cost For Class-Imbalance Learning

Classifying protein-protein interaction articles using word and syntactic features

Deep active learning models for imbalanced image classification