Abstract:Motivation: The powerful learning ability of a convolutional neural network (CNN) to perform functional classification of DNA/RNA sequences could provide valuable clues for the discovery of underlying biological mechanisms. Currently, however, the only way to interpret the direct application of a convolutional kernel to DNA/RNA sequences is the heuristic construction of a position weight matrix (PWM) from fragments scored highly by that kernel; whether the resulting PWM still performs the sequence classification well is unclear. Results: We developed a novel kernel-to-PWM transformation whose result is theoretically provable. Specifically, we proved that the log-likelihood of the resulting PWM of any DNA/RNA sequence is exactly the sum of a constant and the convolution of the original kernel on the same sequence. Importantly, we further proved that the resulting PWM demonstrates the same performance, in theory, as the original kernel under popular CNN frameworks. As expected, the transformation rivaled the performance of the heuristic PWMs in terms of sequence classification, whether the discriminative motif was sequence- or structure-conserved. The transformation also faithfully reproduced the output of trained CNN models where the heuristic one failed. These results compelled us to further develop a maximum likelihood estimation of the optimal PWM for each kernel and a back-transformation of predefined PWMs into kernels. These tools can benefit the biological interpretation of kernel signals. Availability: Python scripts for the transformation from kernel to PWM, the inverted transformation from PWM to kernel, and the maximum likelihood estimation of optimal PWM are available through ftp://ftp.cbi.pku.edu.cn/pub/software/CBI/k2p or https://github.com/gao-lab/kernel-to-PWM .

An Exact Transformation of Convolutional Kernels Enables Accurate Identification of Sequence Motifs

An exact transformation for CNN kernel enables accurate sequence motif identification and leads to a potentially full probabilistic interpretation of CNN

Gene Prediction by the Noise-Assisted MEMD and Wavelet Transform for Identifying the Protein Coding Regions

Inherently interpretable position-aware convolutional motif kernel networks for biological sequencing data

Convolutional Motif Kernel Networks

NeuronMotif: Deciphering Cis-Regulatory Codes by Layer-Wise Demixing of Deep Neural Networks.

Identifying Complex Motifs in Massive Omics Data with a Variable-Convolutional Layer in Deep Neural Network

Biological Sequence Kernels with Guaranteed Flexibility

CNNsite: Prediction of DNA-binding Residues in Proteins Using Convolutional Neural Network with Sequence Features

An Interpretation of Convolutional Neural Networks for Motif Finding from the View of Probability

Prediction of DNA-binding Residues from Sequence Information Using Convolutional Neural Network.

Deepprune: Learning Efficient and Interpretable Convolutional Networks Through Weight Pruning for Predicting DNA-protein Binding

A Quantum Chemical Convolutional Neural Network Model for Predicting Thermodynamics and Kinetics of DNA Molecules from Sequences

Deep Motif Dashboard: Visualizing and Understanding Genomic Sequences Using Deep Neural Networks

NeuronMotif: Deciphering transcriptional cis-regulatory codes from deep neural networks

On minimizers and convolutional filters: theoretical connections and applications to genome analysis

Motto: Representing Motifs in Consensus Sequences with Minimum Information Loss

Deep Motif: Visualizing Genomic Sequence Classifications

Identification of Protein Lysine Crotonylation Sites by a Deep Learning Framework with Convolutional Neural Networks

Computational Discovery of Regulatory DNA Motifs Using Evolutionary Computation

Idrbp_mmc: Identifying DNA-Binding Proteins and RNA-Binding Proteins Based on Multi-Label Learning Model and Motif-Based Convolutional Neural Network.