DebiasedDTA: A Framework for Improving the Generalizability of Drug-Target Affinity Prediction Models

Rıza Özçelik,Alperen Bağ,Berk Atıl,Melih Barsbey,Arzucan Özgür,Elif Özkırımlı

DOI: https://doi.org/10.48550/arXiv.2107.05556

2023-01-09

Abstract:Computational models that accurately predict the binding affinity of an input protein-chemical pair can accelerate drug discovery studies. These models are trained on available protein-chemical interaction datasets, which may contain dataset biases that may lead the model to learn dataset-specific patterns, instead of generalizable relationships. As a result, the prediction performance of models drops for previously unseen biomolecules, $\textit{i.e.}$ the prediction models cannot generalize to biomolecules outside of the dataset. The latest approaches that aim to improve model generalizability either have limited applicability or introduce the risk of degrading prediction performance. Here, we present DebiasedDTA, a novel drug-target affinity (DTA) prediction model training framework that addresses dataset biases to improve the generalizability of affinity prediction models. DebiasedDTA reweights the training samples to mitigate the effect of dataset biases and is applicable to most DTA prediction models. The results suggest that models trained in the DebiasedDTA framework can achieve improved generalizability in predicting the interactions of the previously unseen biomolecules, as well as performance improvements on those previously seen. Extensive experiments with different biomolecule representations, model architectures, and datasets demonstrate that DebiasedDTA can upgrade DTA prediction models irrespective of the biomolecule representation, model architecture, and training dataset. Last but not least, we release DebiasedDTA as an open-source python library to enable other researchers to debias their own predictors and/or develop their own debiasing methods. We believe that this python library will corroborate and foster research to develop more generalizable DTA prediction models.

Quantitative Methods,Machine Learning

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to improve the generalization ability of drug - target affinity prediction models on unseen biomolecules. Specifically, existing prediction models often learn dataset - specific patterns rather than broader, generalizable relationships due to biases in the training datasets. This leads to a decline in the prediction performance of the models when faced with previously unseen biomolecules. The paper proposes a new framework, DebiasedDTA, which aims to improve the generalization ability of the model by re - weighting training samples to mitigate the impact of dataset biases.

### Paper Background
- **Drug Discovery**: Accurately predicting the binding affinity of protein - chemical pairs can accelerate drug discovery research.
- **Dataset Bias**: Existing models are usually trained on specific datasets, which may contain biases, causing the models to learn dataset - specific patterns rather than universally applicable relationships.
- **Generalization Problem**: Therefore, these models perform poorly when predicting unseen biomolecules.

### Solution
- **DebiasedDTA Framework**: This framework mitigates the impact of dataset biases by re - weighting training samples and is applicable to most drug - target affinity (DTA) prediction models.
- **Two - stage Method**:
- **Guide Model**: Learns how to re - weight the training set so that the model can learn robust relationships between biomolecules and binding affinities, rather than dataset - specific spurious associations.
- **Predictor Model**: Trains using the weights generated by the guide model, gradually adjusting the weights of the training data to better generalize to unseen biomolecules.

### Experimental Results
- **Performance Improvement**: The experimental results show that the model under the DebiasedDTA framework performs better when predicting unseen biomolecules, and also has improved performance on known biomolecules.
- **Comparison with Existing Methods**: Compared with existing state - of - the - art de - biasing methods (such as AVE), DebiasedDTA shows better performance on multiple test sets.

### Main Contributions
- **Improving Generalization Ability**: The DebiasedDTA framework significantly improves the generalization ability of DTA prediction models on unseen biomolecules.
- **Generality**: This framework is applicable to different biomolecule representations, model architectures, and training datasets.
- **Open - source Tool**: The authors released the pydebiaseddta library for other researchers to use and develop new de - biasing methods.

In conclusion, by proposing the DebiasedDTA framework, this paper effectively solves the generalization problem of drug - target affinity prediction models on unseen biomolecules, providing strong support for research in the field of drug discovery.