Abstract:Discovering DNA regulatory sequence motifs and their relative positions is vital to understanding the mechanisms of gene expression regulation. Although deep convolutional neural networks (CNNs) have achieved great success in predicting cis-regulatory elements, the discovery of motifs and their combinatorial patterns from these CNN models has remained difficult. We show that the main difficulty is due to the problem of multifaceted neurons which respond to multiple types of sequence patterns. Since existing interpretation methods were mainly designed to visualize the class of sequences that can activate the neuron, the resulting visualization will correspond to a mixture of patterns. Such a mixture is usually difficult to interpret without resolving the mixed patterns. We propose the NeuronMotif algorithm to interpret such neurons. Given any convolutional neuron (CN) in the network, NeuronMotif first generates a large sample of sequences capable of activating the CN, which typically consists of a mixture of patterns. Then, the sequences are "demixed" in a layer-wise manner by backward clustering of the feature maps of the involved convolutional layers. NeuronMotif can output the sequence motifs, and the syntax rules governing their combinations are depicted by position weight matrices organized in tree structures. Compared to existing methods, the motifs found by NeuronMotif have more matches to known motifs in the JASPAR database. The higher-order patterns uncovered for deep CNs are supported by the literature and ATAC-seq footprinting. Overall, NeuronMotif enables the deciphering of cis-regulatory codes from deep CNs and enhances the utility of CNN in genome interpretation.

NeuronMotif: Deciphering transcriptional cis-regulatory codes from deep neural networks

NeuronMotif: Deciphering Cis-Regulatory Codes by Layer-Wise Demixing of Deep Neural Networks.

Unveil cis -acting combinatorial mRNA motifs by interpreting deep neural network

Deep Motif Dashboard: Visualizing and Understanding Genomic Sequences Using Deep Neural Networks

A mechanistically interpretable neural network for regulatory genomics

Deep Motif: Visualizing Genomic Sequence Classifications

Neuronal Motifs Reveal Backbone Structure and Influential Neurons of Neural Network in C. Elegans

Deciphering gene regulation from gene expression dynamics using deep neural network

A novel motif-discovery algorithm to identify co-regulatory motifs in large transcription factor and microRNA co-regulatory networks in human.

A survey on deep learning in DNA/RNA motif mining

Dissecting the cis-regulatory syntax of transcription initiation with deep learning

DeepSS: Exploring Splice Site Motif Through Convolutional Neural Network Directly from DNA Sequence

Functions of Neuronal Network Motifs

An Efficient Network Motif Discovery Approach for Co-Regulatory Networks.

An Interpretation of Convolutional Neural Networks for Motif Finding from the View of Probability

Assessing deep learning algorithms in cis-regulatory motif finding based on genomic sequencing data

Interpreting cis-regulatory interactions from large-scale deep neural networks

Prediction of DNA-binding Residues from Sequence Information Using Convolutional Neural Network.

Motif distribution and function of sparse deep neural networks

MotifHub: Detection of trans-acting DNA motif group with probabilistic modeling algorithm

Motif Discoveries in Unaligned Molecular Sequences Using Self-Organizing Neural Networks