Abstract:BackgroundIn recent years, research in artificial neural networks has resurged, now under the deep-learning umbrella, and grown extremely popular. Recently reported success of DL techniques in crowd-sourced QSAR and predictive toxicology competitions has showcased these methods as powerful tools in drug-discovery and toxicology research. The aim of this work was dual, first large number of hyper-parameter configurations were explored to investigate how they affect the performance of DNNs and could act as starting points when tuning DNNs and second their performance was compared to popular methods widely employed in the field of cheminformatics namely Naïve Bayes, k-nearest neighbor, random forest and support vector machines. Moreover, robustness of machine learning methods to different levels of artificially introduced noise was assessed. The open-source Caffe deep-learning framework and modern NVidia GPU units were utilized to carry out this study, allowing large number of DNN configurations to be explored.ResultsWe show that feed-forward deep neural networks are capable of achieving strong classification performance and outperform shallow methods across diverse activity classes when optimized. Hyper-parameters that were found to play critical role are the activation function, dropout regularization, number hidden layers and number of neurons. When compared to the rest methods, tuned DNNs were found to statistically outperform, with p value <0.01 based on Wilcoxon statistical test. DNN achieved on average MCC units of 0.149 higher than NB, 0.092 than kNN, 0.052 than SVM with linear kernel, 0.021 than RF and finally 0.009 higher than SVM with radial basis function kernel. When exploring robustness to noise, non-linear methods were found to perform well when dealing with low levels of noise, lower than or equal to 20%, however when dealing with higher levels of noise, higher than 30%, the Naïve Bayes method was found to perform well and even outperform at the highest level of noise 50% more sophisticated methods across several datasets.

A Deep Learning Approach for Modelling the Complex Relationship between Environmental Factors and Biological Features

Biological Factor Regulatory Neural Network

Artificial Neural Network Classification of High Dimensional Data with Novel Optimization Approach of Dimension Reduction

Disentangling Genotype and Environment Specific Latent Features for Improved Trait Prediction using a Compositional Autoencoder

Robust Biomarker Discovery for Microbiome-Wide Association Studies.

Modeling genome-wide by environment interactions through omnigenic interactome networks

Application of Artificial Neural Networks in Global Climate Change and Ecological Research: an Overview

A novel neural network model with distributed evolutionary approach for big data classification

RDAforest: identifying environmental drivers of polygenic adaptation.

Nature vs. Nurture: The Role of Environmental Resources in Evolutionary Deep Intelligence

Evaluation of Deep Species Distribution Models using Environment and Co-occurrences

Predicting and Navigating Environmental Transformations using Machine Learning

Deep-learning: investigating deep neural networks hyper-parameters and comparison of performance to shallow methods for modeling bioactivity data

Elephant Search with Deep Learning for Microarray Data Analysis

A novel deep mining model for effective knowledge discovery from omics data

Using machine learning to integrate genetic and environmental data to model genotype-by-environment interactions

Neural Networks from Biological to Artificial and Vice Versa

Machine Learning Using Neural Networks for Metabolomic Pathway Analyses

Functional Neural Networks for High-Dimensional Genetic Data Analysis

Crop genomic selection with deep learning and environmental data: A survey

Neural Network Architecture Search with AMBER