Abstract:MOTIVATION:Experimental techniques for measuring chromatin accessibility are expensive and time consuming, appealing for the development of computational approaches to predict open chromatin regions from DNA sequences. Along this direction, existing methods fall into two classes: one based on handcrafted k -mer features and the other based on convolutional neural networks. Although both categories have shown good performance in specific applications thus far, there still lacks a comprehensive framework to integrate useful k -mer co-occurrence information with recent advances in deep learning.RESULTS:We fill this gap by addressing the problem of chromatin accessibility prediction with a convolutional Long Short-Term Memory (LSTM) network with k -mer embedding. We first split DNA sequences into k -mers and pre-train k -mer embedding vectors based on the co-occurrence matrix of k -mers by using an unsupervised representation learning approach. We then construct a supervised deep learning architecture comprised of an embedding layer, three convolutional layers and a Bidirectional LSTM (BLSTM) layer for feature learning and classification. We demonstrate that our method gains high-quality fixed-length features from variable-length sequences and consistently outperforms baseline methods. We show that k -mer embedding can effectively enhance model performance by exploring different embedding strategies. We also prove the efficacy of both the convolution and the BLSTM layers by comparing two variations of the network architecture. We confirm the robustness of our model to hyper-parameters by performing sensitivity analysis. We hope our method can eventually reinforce our understanding of employing deep learning in genomic studies and shed light on research regarding mechanisms of chromatin accessibility.AVAILABILITY AND IMPLEMENTATION:The source code can be downloaded from https://github.com/minxueric/ismb2017_lstm .CONTACT:tingchen@tsinghua.edu.cn or ruijiang@tsinghua.edu.cn.SUPPLEMENTARY INFORMATION:Supplementary materials are available at Bioinformatics online.

DeepANF: A Deep Attentive Neural Framework with Distributed Representation for Chromatin Accessibility Prediction

Attentive gated neural networks for identifying chromatin accessibility

HiCArch: A Deep Learning-based Hi-C Data Predictor

DeepFormer: a hybrid network based on convolutional neural network and flow-attention mechanism for identifying the function of DNA sequences

IChrom-Deep: An Attention-Based Deep Learning Model for Identifying Chromatin Interactions

DeepCAGE: Incorporating Transcription Factors in Genome-wide Prediction of Chromatin Accessibility

Chromatin Accessibility Prediction Via Convolutional Long Short-Term Memory Networks with K-Mer Embedding.

DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network

Chromatin Accessibility Prediction Via a Hybrid Deep Convolutional Neural Network

DeepHistone: a Deep Learning Approach to Predicting Histone Modifications

Prediction of Transcription Factor Binding Sites with an Attention Augmented Convolutional Neural Network

Predicting Enhancers with Deep Convolutional Neural Networks

Prediction of Transcription Factor Binding Sites Using a Combined Deep Learning Approach

DeepChrome: deep-learning for predicting gene expression from histone modifications

Discriminative histone imputation using chromatin accessibility

DeepTACT: predicting high-resolution chromatin contacts via bootstrapping deep learning

High-resolution transcription factor binding sites prediction improved performance and interpretability by deep learning method

An Integrative Framework for Combining Sequence and Epigenomic Data to Predict Transcription Factor Binding Sites Using Deep Learning

DeepTACT: Predicting 3D Chromatin Contacts Via Bootstrapping Deep Learning.

DeepATT: a hybrid category attention neural network for identifying functional effects of DNA sequences

A Unified Deep Learning Framework for Single-Cell ATAC-Seq Analysis Based on ProdDep Transformer Encoder