Abstract:The application of Artificial Intelligence (AI) to screen drug molecules with potential therapeutic effects has revolutionized the drug discovery process, with significantly lower economic cost and time consumption than the traditional drug discovery pipeline. With the great power of AI, it is possible to rapidly search the vast chemical space for potential drug-target interactions (DTIs) between candidate drug molecules and disease protein targets. However, only a small proportion of molecules have labelled DTIs, consequently limiting the performance of AI-based drug screening. To solve this problem, a machine learning-based approach with great ability to generalize DTI prediction across molecules is desirable. Many existing machine learning approaches for DTI identification failed to exploit the full information with respect to the topological structures of candidate molecules. To develop a better approach for DTI prediction, we propose GraphormerDTI, which employs the powerful Graph Transformer neural network to model molecular structures. GraphormerDTI embeds molecular graphs into vector-format representations through iterative Transformer-based message passing, which encodes molecules' structural characteristics by node centrality encoding, node spatial encoding and edge encoding. With a strong structural inductive bias, the proposed GraphormerDTI approach can effectively infer informative representations for out-of-sample molecules and as such, it is capable of predicting DTIs across molecules with an exceptional performance. GraphormerDTI integrates the Graph Transformer neural network with a 1-dimensional Convolutional Neural Network (1D-CNN) to extract the drugs' and target proteins' representations and leverages an attention mechanism to model the interactions between them. To examine GraphormerDTI's performance for DTI prediction, we conduct experiments on three benchmark datasets, where GraphormerDTI achieves a superior performance than five state-of-the-art baselines for out-of-molecule DTI prediction, including GNN-CPI, GNN-PT, DeepEmbedding-DTI, MolTrans and HyperAttentionDTI, and is on a par with the best baseline for transductive DTI prediction. The source codes and datasets are publicly accessible at https://github.com/mengmeng34/GraphormerDTI .

Geometric Transformers for Protein Interface Contact Prediction

Protein interaction interface region prediction by geometric deep learning

PeSTo: parameter-free geometric deep learning for accurate prediction of protein binding interfaces

Inferring Protein-Protein Interface from Geometry of Unbound Structures

3D-Transformer: Molecular Representation with Transformer in 3D Space

Protein–protein contact prediction by geometric triangle-aware protein language models

Co-evolution Transformer for Protein Contact Prediction.

Predicting Drug-target Binding Affinity Based on Graph Isomorphism Network and iTransformer

GraphormerDTI: A graph transformer-based approach for drug-target interaction prediction

Protein language model-embedded geometric graphs power inter-protein contact prediction

Improving Protein-peptide Interface Predictions in the Low Data Regime

GEFormerDTA: drug target affinity prediction based on transformer graph for early fusion

Protein language model embedded geometric graphs power inter-protein contact prediction

DeepHomo2.0: Improved Protein-Protein Contact Prediction of Homodimers by Transformer-Enhanced Deep Learning.

Context-aware geometric deep learning for protein sequence design

Deep Transfer Learning for Inter-Chain Contact Predictions of Transmembrane Protein Complexes

PeSTo-Carbs: Geometric Deep Learning for Prediction of Protein-Carbohydrate Binding Interfaces

Geometric Transformer with Interatomic Positional Encoding

Trimer Protein-Protein Complex Interface Interacting Residue Pairs Prediction Using Deep Learning Approach.

GraphsformerCPI: Graph Transformer for Compound–Protein Interaction Prediction

ComplexContact: a Web Server for Inter-Protein Contact Prediction Using Deep Learning