Abstract:Drug discovery aims to keep fueling new medicines to cure and palliate many ailments and some untreatable diseases that still afflict humanity. The ADME/Tox (absorption, distribution, metabolism, excretion/toxicity) properties of candidate drug molecules are key factors that determine the safety, uptake, elimination, metabolic behavior and effectiveness of drug research and development. The predictive technique of ADME/Tox drastically reduces the fraction of pharmaceutics-related failure in the early stages of drug development. Driven by the expectation of accelerated timelines, reduced costs and the potential to reveal hidden insights from vast datasets, artificial intelligence techniques such as Graphormer are showing increasing promise and usefulness to perform custom models for molecule modeling tasks. However, Graphormer and other transformer-based models do not consider the molecular fingerprint, as well as the physicochemicals that have been proved effective in traditional computational drug research. Here, we propose an enhanced model based on Graphormer which uses a tree model that fully integrates some known information and achieves better prediction and interpretability. More importantly, the model achieves new state-of-the-art results on ADME/Tox properties prediction benchmarks, surpassing several challenging models. Experimental results demonstrate an average SMAPE (Symmetric Mean Absolute Percentage Error) of 18.9 and a PCC (Pearson Correlation Coefficient) of 0.86 on ADME/Tox prediction test sets. These findings highlight the efficacy of our approach and its potential to enhance drug discovery processes. By leveraging the strengths of Graphormer and incorporating additional molecular descriptors, our model offers improved predictive capabilities, thus contributing to the advancement of ADME/Tox prediction in drug development. The integration of various information sources further enables better interpretability, aiding researchers in understanding the underlying factors influencing the predictions. Overall, our work demonstrates the potential of our enhanced model to expedite drug discovery, reduce costs, and enhance the success rate of our pharmaceutical development efforts.

Amesformer: State-of-the-Art Mutagenicity Prediction with Graph Transformers

Amesformer: a graph transformer neural network for mutagenicity prediction

AMPred-CNN: Ames mutagenicity prediction model based on convolutional neural networks

An Evolved Transformer Model for ADME/Tox Prediction

Development of a robust Machine learning model for Ames test outcome prediction

DeepAmes: A deep learning-powered Ames test predictive model with potential for regulatory application

Evolutionary Ensemble for In Silico Prediction of Ames Test Mutagenicity

GeoScatt-GNN: A Geometric Scattering Transform-Based Graph Neural Network Model for Ames Mutagenicity Prediction

Stacked ensemble\-based mutagenicity prediction model using multiple modalities with graph attention network

Mechanistic Task Groupings Enhance Multitask Deep Learning of Strain-Specific Ames Mutagenicity

Hi-MGT: A hybrid molecule graph transformer for toxicity identification

Graph Transformer Foundation Model for modeling ADMET properties

Deciphering the Language of Nature: A transformer-based language model for deleterious mutations in proteins

Modeling the Ames test

ABT-MPNN: an atom-bond transformer-based message-passing neural network for molecular property prediction

Improvement of quantitative structure–activity relationship (QSAR) tools for predicting Ames mutagenicity: outcomes of the Ames/QSAR International Challenge Project

Synergistic Fusion of Graph and Transformer Features for Enhanced Molecular Property Prediction

Algebraic graph-assisted bidirectional transformers for molecular property prediction

Chemformer: a pre-trained transformer for computational chemistry

Predicting protein thermal stability changes upon single and multi-point mutations via restricted attention subgraph neural network

AMPL: A Data-Driven Modeling Pipeline for Drug Discovery