Abstract:The application of Artificial Intelligence (AI) to screen drug molecules with potential therapeutic effects has revolutionized the drug discovery process, with significantly lower economic cost and time consumption than the traditional drug discovery pipeline. With the great power of AI, it is possible to rapidly search the vast chemical space for potential drug-target interactions (DTIs) between candidate drug molecules and disease protein targets. However, only a small proportion of molecules have labelled DTIs, consequently limiting the performance of AI-based drug screening. To solve this problem, a machine learning-based approach with great ability to generalize DTI prediction across molecules is desirable. Many existing machine learning approaches for DTI identification failed to exploit the full information with respect to the topological structures of candidate molecules. To develop a better approach for DTI prediction, we propose GraphormerDTI, which employs the powerful Graph Transformer neural network to model molecular structures. GraphormerDTI embeds molecular graphs into vector-format representations through iterative Transformer-based message passing, which encodes molecules' structural characteristics by node centrality encoding, node spatial encoding and edge encoding. With a strong structural inductive bias, the proposed GraphormerDTI approach can effectively infer informative representations for out-of-sample molecules and as such, it is capable of predicting DTIs across molecules with an exceptional performance. GraphormerDTI integrates the Graph Transformer neural network with a 1-dimensional Convolutional Neural Network (1D-CNN) to extract the drugs' and target proteins' representations and leverages an attention mechanism to model the interactions between them. To examine GraphormerDTI's performance for DTI prediction, we conduct experiments on three benchmark datasets, where GraphormerDTI achieves a superior performance than five state-of-the-art baselines for out-of-molecule DTI prediction, including GNN-CPI, GNN-PT, DeepEmbedding-DTI, MolTrans and HyperAttentionDTI, and is on a par with the best baseline for transductive DTI prediction. The source codes and datasets are publicly accessible at https://github.com/mengmeng34/GraphormerDTI .

Combining graph neural networks and transformers for few-shot nuclear receptor binding activity prediction

Few-shot learning with transformers via graph embeddings for molecular property prediction

Profiling prediction of nuclear receptor modulators with multi-task deep learning methods: toward the virtual screening

BiTGNN: Prediction of drug–target interactions based on bidirectional transformer and graph neural network on heterogeneous graph

Metapath-aggregated heterogeneous graph neural network for drug-target interaction prediction

Predicting Drug-target Binding Affinity Based on Graph Isomorphism Network and iTransformer

Predicting Binding from Screening Assays with Transformer Network Embeddings

Towards a Better Model with Dual Transformer for Drug Response Prediction

NHGNN-DTA: a node-adaptive hybrid graph neural network for interpretable drug–target binding affinity prediction

Reinforced Metapath Optimization in Heterogeneous Information Networks for Drug-Target Interaction Prediction

Meta Learning With Graph Attention Networks for Low-Data Drug Discovery

Improved Drug-target Interaction Prediction with Intermolecular Graph Transformer

Benchmark on Drug Target Interaction Modeling from a Structure Perspective

GraphormerDTI: A graph transformer-based approach for drug-target interaction prediction

An Edge-based Graph Transformer Network for Anti-Cancer Drug Synergy Prediction

Meta-MolNet: A Cross-Domain Benchmark for Few Examples Drug Discovery

GPCNDTA: Prediction of drug-target binding affinity through cross-attention networks augmented with graph features and pharmacophores

Graph neural processes for molecules: an evaluation on docking scores and strategies to improve generalization

Unlocking the therapeutic potential of drug combinations through synergy prediction using graph transformer networks

SSR-DTA: Substructure-aware multi-layer graph neural networks for drug-target binding affinity prediction

MolTrans: Molecular Interaction Transformer for Drug Target Interaction Prediction