Abstract:MOTIVATION:Experimental techniques for measuring chromatin accessibility are expensive and time consuming, appealing for the development of computational approaches to predict open chromatin regions from DNA sequences. Along this direction, existing methods fall into two classes: one based on handcrafted k -mer features and the other based on convolutional neural networks. Although both categories have shown good performance in specific applications thus far, there still lacks a comprehensive framework to integrate useful k -mer co-occurrence information with recent advances in deep learning.RESULTS:We fill this gap by addressing the problem of chromatin accessibility prediction with a convolutional Long Short-Term Memory (LSTM) network with k -mer embedding. We first split DNA sequences into k -mers and pre-train k -mer embedding vectors based on the co-occurrence matrix of k -mers by using an unsupervised representation learning approach. We then construct a supervised deep learning architecture comprised of an embedding layer, three convolutional layers and a Bidirectional LSTM (BLSTM) layer for feature learning and classification. We demonstrate that our method gains high-quality fixed-length features from variable-length sequences and consistently outperforms baseline methods. We show that k -mer embedding can effectively enhance model performance by exploring different embedding strategies. We also prove the efficacy of both the convolution and the BLSTM layers by comparing two variations of the network architecture. We confirm the robustness of our model to hyper-parameters by performing sensitivity analysis. We hope our method can eventually reinforce our understanding of employing deep learning in genomic studies and shed light on research regarding mechanisms of chromatin accessibility.AVAILABILITY AND IMPLEMENTATION:The source code can be downloaded from https://github.com/minxueric/ismb2017_lstm .CONTACT:tingchen@tsinghua.edu.cn or ruijiang@tsinghua.edu.cn.SUPPLEMENTARY INFORMATION:Supplementary materials are available at Bioinformatics online.

ChiMamba: Predicting Chromatin Interactions Based on Mamba

Chromatin Accessibility Prediction Via Convolutional Long Short-Term Memory Networks with K-Mer Embedding.

Improving Cell-type-specific 3D Genome Architectures Prediction Leveraging Graph Neural Networks

IChrom-Deep: An Attention-Based Deep Learning Model for Identifying Chromatin Interactions

DeciMamba: Exploring the Length Extrapolation Potential of Mamba

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation

BioMamba: A Pre-trained Biomedical Language Representation Model Leveraging Mamba

ReMamba: Equip Mamba with Effective Long-Sequence Modeling

A Survey of Mamba

Chrombus-XMBD: A Graph Generative Model Predicting 3D-Genome,ab Initiofrom Chromatin Features

DGRNA: a long-context RNA foundation model with bidirectional attention Mamba2

Discriminative histone imputation using chromatin accessibility

Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data

DeepCBA: A deep learning framework for gene expression prediction in maize based on DNA sequences and chromatin interactions

Bi-Mamba+: Bidirectional Mamba for Time Series Forecasting

DeepCBA: a Deep Learning Framework for Gene Expression Prediction in Maize Based on DNA Sequence and Chromatin Interaction

DeepANF: A Deep Attentive Neural Framework with Distributed Representation for Chromatin Accessibility Prediction

Protein-Mamba: Biological Mamba Models for Protein Function Prediction