Abstract:MOTIVATION:Experimental techniques for measuring chromatin accessibility are expensive and time consuming, appealing for the development of computational approaches to predict open chromatin regions from DNA sequences. Along this direction, existing methods fall into two classes: one based on handcrafted k -mer features and the other based on convolutional neural networks. Although both categories have shown good performance in specific applications thus far, there still lacks a comprehensive framework to integrate useful k -mer co-occurrence information with recent advances in deep learning.RESULTS:We fill this gap by addressing the problem of chromatin accessibility prediction with a convolutional Long Short-Term Memory (LSTM) network with k -mer embedding. We first split DNA sequences into k -mers and pre-train k -mer embedding vectors based on the co-occurrence matrix of k -mers by using an unsupervised representation learning approach. We then construct a supervised deep learning architecture comprised of an embedding layer, three convolutional layers and a Bidirectional LSTM (BLSTM) layer for feature learning and classification. We demonstrate that our method gains high-quality fixed-length features from variable-length sequences and consistently outperforms baseline methods. We show that k -mer embedding can effectively enhance model performance by exploring different embedding strategies. We also prove the efficacy of both the convolution and the BLSTM layers by comparing two variations of the network architecture. We confirm the robustness of our model to hyper-parameters by performing sensitivity analysis. We hope our method can eventually reinforce our understanding of employing deep learning in genomic studies and shed light on research regarding mechanisms of chromatin accessibility.AVAILABILITY AND IMPLEMENTATION:The source code can be downloaded from https://github.com/minxueric/ismb2017_lstm .CONTACT:tingchen@tsinghua.edu.cn or ruijiang@tsinghua.edu.cn.SUPPLEMENTARY INFORMATION:Supplementary materials are available at Bioinformatics online.

Attentive gated neural networks for identifying chromatin accessibility

DeepANF: A Deep Attentive Neural Framework with Distributed Representation for Chromatin Accessibility Prediction

Chromatin Accessibility Prediction Via Convolutional Long Short-Term Memory Networks with K-Mer Embedding.

Learning Tn5 Sequence Bias from ATAC-seq on Naked Chromatin

DeepCAGE: Incorporating Transcription Factors in Genome-wide Prediction of Chromatin Accessibility

GNet: an Integrated Context-Aware Neural Framework for Transcription Factor Binding Signal at Single Nucleotide Resolution Prediction

Attend and Predict: Understanding Gene Regulation by Selective Attention on Chromatin

Graph Attention Network with Convolutional Layer for Predicting Gene Regulations from Single-Cell Ribonucleic Acid Sequence Data

Chromatin Accessibility Prediction Via a Hybrid Deep Convolutional Neural Network

LoopNetica: Predicting Chromatin Loops Using Convolutional Neural Networks and Attention Mechanisms

Prediction of Transcription Factor Binding Sites with an Attention Augmented Convolutional Neural Network

Identification of DNA Modification Sites Based on Elastic Net and Bidirectional Gated Recurrent Unit with Convolutional Neural Network

DeepGRN: prediction of transcription factor binding site across cell-types using attention-based deep neural networks

Graph Convolutional Networks for Epigenetic State Prediction Using Both Sequence and 3D Genome Data

The Evolution and Mutational Robustness of Chromatin Accessibility in Drosophila

Exploring Protein-DNA Binding Residue Prediction and Consistent Interpretability Analysis Using Deep Learning

iEnhancer-GAN: A Deep Learning Framework in Combination with Word Embedding and Sequence Generative Adversarial Net to Identify Enhancers and Their Strength

Chromatin interaction-aware gene regulatory modeling with graph attention networks

GSRNet, an adversarial training-based deep framework with multi-scale CNN and BiGRU for predicting genomic signals and regions

Identifying enhancer-promoter interactions with neural network based on pre-trained DNA vectors and attention mechanism

IChrom-Deep: An Attention-Based Deep Learning Model for Identifying Chromatin Interactions