Abstract:BackgroundIn recent years, research in artificial neural networks has resurged, now under the deep-learning umbrella, and grown extremely popular. Recently reported success of DL techniques in crowd-sourced QSAR and predictive toxicology competitions has showcased these methods as powerful tools in drug-discovery and toxicology research. The aim of this work was dual, first large number of hyper-parameter configurations were explored to investigate how they affect the performance of DNNs and could act as starting points when tuning DNNs and second their performance was compared to popular methods widely employed in the field of cheminformatics namely Naïve Bayes, k-nearest neighbor, random forest and support vector machines. Moreover, robustness of machine learning methods to different levels of artificially introduced noise was assessed. The open-source Caffe deep-learning framework and modern NVidia GPU units were utilized to carry out this study, allowing large number of DNN configurations to be explored.ResultsWe show that feed-forward deep neural networks are capable of achieving strong classification performance and outperform shallow methods across diverse activity classes when optimized. Hyper-parameters that were found to play critical role are the activation function, dropout regularization, number hidden layers and number of neurons. When compared to the rest methods, tuned DNNs were found to statistically outperform, with p value <0.01 based on Wilcoxon statistical test. DNN achieved on average MCC units of 0.149 higher than NB, 0.092 than kNN, 0.052 than SVM with linear kernel, 0.021 than RF and finally 0.009 higher than SVM with radial basis function kernel. When exploring robustness to noise, non-linear methods were found to perform well when dealing with low levels of noise, lower than or equal to 20%, however when dealing with higher levels of noise, higher than 30%, the Naïve Bayes method was found to perform well and even outperform at the highest level of noise 50% more sophisticated methods across several datasets.

Efficient Toxicity Prediction via Simple Features Using Shallow Neural Networks and Decision Trees

Toxicity Prediction using Deep Learning

A Deep Learning Based Multi-Model Approach for Predicting Drug-Like Chemical Compound’s Toxicity

A deep learning based multi-model approach for predicting drug-like chemical compound's toxicity

Interpreting Neural Network Models for Toxicity Prediction by Extracting Learned Chemical Features

Deep Learning Based Regression and Multiclass Models for Acute Oral Toxicity Prediction with Automatic Chemical Feature Extraction.

Quantitative Toxicity Prediction via Meta Ensembling of Multitask Deep Learning Models

Descriptive Analysis of Feature Selection and Clustering Algorithms for Optimized Drug Toxicity Prediction Model

Deep learning for predicting toxicity of chemicals: a mini review

Explainable AI and tree-based ensemble models: a comparative study in predicting chemical pulmonary toxicity

Co‐Model for Chemical Toxicity Prediction Based on Multi‐task Deep Learning

Deep Learning Based Regression and Multi-class Models for Acute Oral Toxicity Prediction with Automatic Chemical Feature Extraction

Explaining Chemical Toxicity using Missing Features

Novel Approach of Deep Learning in Toxicity Prediction

In Silico Prediction of Chemical Neurotoxicity Using Machine Learning.

ChemXTree: A Feature-Enhanced Graph Neural Network-Neural Decision Tree Framework for ADMET Prediction

Multitask CapsNet: an Imbalanced Data Deep Learning Method for Predicting Toxicants

Toxicity Detection in Drug Candidates using Simplified Molecular-Input Line-Entry System

Accurate Clinical Toxicity Prediction using Multi-task Deep Neural Nets and Contrastive Molecular Explanations

Deep-learning: investigating deep neural networks hyper-parameters and comparison of performance to shallow methods for modeling bioactivity data

ToxicBlend: Virtual Screening of Toxic Compounds with Ensemble Predictors