Abstract:Background: The data deluge can leverage sophisticated ML techniques for functionally annotating the regulatory non-coding genome. The challenge lies in selecting the appropriate classifier for the specific functional annotation problem, within the bounds of the hardware constraints and the model's complexity. In our system AIKYATAN, we annotate distal epigenomic regulatory sites, e.g., enhancers. Specifically, we develop a binary classifier that classifies genome sequences as distal regulatory regions or not, given their histone modifications' combinatorial signatures. This problem is challenging because the regulatory regions are distal to the genes, with diverse signatures across classes (e.g., enhancers and insulators) and even within each class (e.g., different enhancer sub-classes). Results: We develop a suite of ML models, under the banner AIKYATAN, including SVM models, random forest variants, and deep learning architectures, for distal regulatory element (DRE) detection. We demonstrate, with strong empirical evidence, deep learning approaches have a computational advantage. Plus, convolutional neural networks (CNN) provide the best-in-class accuracy, superior to the vanilla variant. With the human embryonic cell line H1, CNN achieves an accuracy of 97.9% and an order of magnitude lower runtime than the kernel SVM. Running on a GPU, the training time is sped up 21x and 30x (over CPU) for DNN and CNN, respectively. Finally, our CNN model enjoys superior prediction performance vis-'a-vis the competition. Specifically, AIKYATAN-CNN achieved 40% higher validation rate versus CSIANN and the same accuracy as RFECS. Conclusions: Our exhaustive experiments using an array of ML tools validate the need for a model that is not only expressive but can scale with increasing data volumes and diversity. In addition, a subset of these datasets have image-like properties and benefit from spatial pooling of features. Our AIKYATAN suite leverages diverse epigenomic datasets that can then be modeled using CNNs with optimized activation and pooling functions. The goal is to capture the salient features of the integrated epigenomic datasets for deciphering the distal (non-coding) regulatory elements, which have been found to be associated with functional variants. Our source code will be made publicly available at: https://bitbucket.org/cellsandmachines/aikyatan.

ChromDL: A Next-Generation Regulatory DNA Classifier

IChrom-Deep: An Attention-Based Deep Learning Model for Identifying Chromatin Interactions

DeepChrome: deep-learning for predicting gene expression from histone modifications

DeepFormer: a hybrid network based on convolutional neural network and flow-attention mechanism for identifying the function of DNA sequences

Interpretable Online Network Dictionary Learning for Inferring Long-Range Chromatin Interactions

Attend and Predict: Understanding Gene Regulation by Selective Attention on Chromatin

DeepCAGE: Incorporating Transcription Factors in Genome-wide Prediction of Chromatin Accessibility

AIKYATAN: mapping distal regulatory elements using convolutional learning on GPU

Predicting Transcription Factor Binding Sites with Deep Learning

DeepChrome 2.0: Investigating and Improving Architectures, Visualizations, & Experiments

Chromatin interaction-aware gene regulatory modeling with graph attention networks

SimpleChrome: Encoding of Combinatorial Effects for Predicting Gene Expression

LoopNetica: Predicting Chromatin Loops Using Convolutional Neural Networks and Attention Mechanisms

DARDN: A deep-learning approach for CTCF binding sequence classification and oncogenic regulatory feature discovery

An attention-based hybrid deep neural networks for accurate identification of transcription factor binding sites

High-resolution transcription factor binding sites prediction improved performance and interpretability by deep learning method

ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants

Chromatin Accessibility Prediction Via a Hybrid Deep Convolutional Neural Network

TFClassPredict: A Novel Deep Learning Framework for Transcription Factor Binding Site Analysis Using Evolutionarily Conserved DNA-Binding Domain Annotations

Using Deep Learning to Predict Transcription Factor Binding Sites Based on Multiple-omics Data