Abstract:In bioinformatics, machine learning-based prediction of drug-target interaction (DTI) plays an important role in virtual screening of drug discovery. DTI prediction, which have been treated as a binary classification problem, depends on the concentration of two molecules, the interaction between two molecules, and other factors. The degree of affinity between a drug molecule (such as a drug compound) and a target molecule (such as a receptor or protein kinase) reflects how tightly the drug binds to a particular target and is quantified by the measurement which can reflect more detailed and specific information than binary relationship. In this study, we proposed an end-to-end model, named AttentionDTA, based on deep learning, which associates attention mechanism to predict the binding affinity of DTI. The novelty in this work is to use attentional mechanisms to consider which subsequences in a protein are more important for a drug and which subsequences in a drug are more important for a protein when predicting its affinity. So that the representational ability of the model is stronger. The model uses one-dimensional Convolution Neural Networks (1D-CNNs) to extract the abstract information of drug and protein, and makes the drug and protein representations mutually adapt through the attention mechanisms. We evaluate our model on two established drug-target affinity benchmark datasets, Davis and KIBA. The model outperforms DeepDTA, a state-of-the-art deep learning method for drug–target binding affinity prediction, with better Mean Squared Error (MSE), Concordance Index (CI), $r_{m}^{2}$, and Area Under Precision Recall Curve (AUPR). Our results show that the attention-based model can effectively extract effective representations by calculating the weight of the representation between the drug and the protein. Finally, we visualize the attention weight. It proves our model can obtain the information of binding sites.

Predicting Task-Driven Attention Via Integrating Bottom-Up Stimulus and Top-Down Guidance

Task Optimization Leads to Human-like Top-down and Bottom-up Attention during Reading Comprehension

Mining Temporal Dynamics with Support Vector Machine for Predicting the Neural Fate of Target in Attentional Blink

Understanding top-down attention using task-oriented ablation design

The Costs and Benefits of Goal-Directed Attention in Deep Convolutional Neural Networks

Deep Visual Attention Prediction

TDAF: Top-Down Attention Framework for Vision Tasks

Depth-aware gaze-following via auxiliary networks for robotics

Unifying Top-down and Bottom-up Scanpath Prediction Using Transformers

Top-Down Neural Attention by Excitation Backprop

Predicting Human Interaction Via Relative Attention Model.

Spatial and Temporal Visual Attention Prediction in Videos Using Eye Movement Data

Predicting Short-Term Next-Active-object Through Visual Attention and Hand Position

FMRI-Guided Time-Symmetric Joint Model for Visual Attention Prediction.

Understanding More about Human and Machine Attention in Deep Neural Networks

Driver attention prediction based on convolution and transformers

Enhancing spiking neural networks with hybrid top-down attention

AttentionDTA: prediction of drug–target binding affinity using attention model

Predicting Auditory Spatial Attention from EEG using Single- and Multi-task Convolutional Neural Networks

Hebbian-Based Neural Networks for Bottom-Up Visual Attention Systems

Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks