Abstract:Bioinformatics is a rapidly growing field involving the application of computational methods to the analysis and interpretation of biological data. An important task in bioinformatics is the identification of novel drug-target interactions (DTIs), which is also an important part of the drug discovery process. Most computational methods for predicting DTI consider it as a binary classification task to predict whether drug target pairs interact with each other. With the increasing amount of drug-target binding affinity data in recent years, this binary classification task can be transformed into a regression task of drug-target affinity (DTA), which reflects the degree of drug-target binding and can provide more detailed and specific information than DTI, making it an important tool in drug discovery through virtual screening. Effectively predicting how compounds interact with targets can help speed up the drug discovery process. In this study, we propose a deep learning model called TC-DTA for the prediction of the DTA, which makes use of the convolutional neural networks (CNN) and encoder module of the transformer architecture. First, the raw drug SMILES strings and protein amino acid sequences are extracted from the dataset. These are then represented using different encoding methods. We then use CNN and the Transformer's encoder module to extract feature information from drug SMILES strings and protein amino acid sequences, respectively. Finally, the feature information obtained is concatenated and fed into a multi-layer perceptron for prediction of the binding affinity score. We evaluated our model on two benchmark DTA datasets, Davis and KIBA, against methods including KronRLS, SimBoost and DeepDTA. On evaluation metrics such as Mean Squared Error, Concordance Index and r2m index, TC-DTA outperforms these baseline methods. These results demonstrate the effectiveness of the Transformer's encoder and CNN in the extraction of meaningful representations from sequences, thereby improving the accuracy of DTA prediction. The deep learning model for DTA prediction can accelerate drug discovery by identifying drug candidates with high binding affinity to specific targets. Compared to traditional methods, the use of machine learning technology allows for a more effective and efficient drug discovery process.

Efficient Training of Transformers for Molecule Property Prediction on Small-scale Datasets

DeepB3P: A transformer-based model for identifying blood-brain barrier penetrating peptides with data augmentation using feedback GAN

3D-Transformer: Molecular Representation with Transformer in 3D Space

Predicting blood–brain barrier permeability of molecules with a large language model and machine learning

Transformers for molecular property prediction: Lessons learned from the past five years

Dynamic Molecular Graph-based Implementation for Biophysical Properties Prediction

DeepBBBP: High accuracy Blood‐Brain‐Barrier Permeability Prediction with a Mixed Deep Learning Model

Parameter-Efficient Transformer with Hybrid Axial-Attention for Medical Image Segmentation

TransFoxMol: predicting molecular property with focused attention

GTAMP-DTA: Graph transformer combined with attention mechanism for drug-target binding affinity prediction

Natural‐Language Processing (NLP) based feature extraction technique in Deep‐Learning model to predict the Blood‐Brain‐Barrier permeability of molecules

A merged molecular representation deep learning method for blood-brain barrier permeability prediction

In Silico Prediction of Blood-Brain Barrier Permeability of Chemical Compounds through Molecular Feature Modeling

TC-DTA: predicting drug-target binding affinity with transformer and convolutional neural networks

Transferring a molecular foundation model for polymer property predictions

Molecular Descriptors Property Prediction Using Transformer-Based Approach

Prediction of blood‐brain barrier permeability using machine learning approaches based on various molecular representation

DeePred-BBB: A Blood Brain Barrier Permeability Prediction Model With Improved Accuracy

Attentive graph neural network models for the prediction of blood-brain barrier permeability

ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction

Brain Network Transformer