Abstract:Enhancer is a class of non-coding DNA cis-acting elements that plays a crucial role in the development of eukaryotes for their transcription. Computational methods for predicting enhancers have been developed and achieve satisfactory performance. However, existing computational methods suffer from experience-based feature engineering and lack of interpretability, which not only limit the representation ability of the models to some extent, but also make it difficult to provide interpretable analysis of the model prediction findings.In this paper, we propose a novel deep-learning-based model, iEnhancer-CLA, for identifying enhancers and their strengths. Specifically, iEnhancer-CLA automatically learns sequence 1D features through multiscale convolutional neural networks (CNN), and employs a self-attention mechanism to represent global features formed by multiple elements (multibody effects). In particular, the model can provide an interpretable analysis of the enhancer motifs and key base signals by decoupling CNN modules and generating self-attention weights. To avoid the bias of setting hyperparameters manually, we construct Bayesian optimization methods to obtain model global optimization hyperparameters. The results demonstrate that our method outperforms existing predictors in terms of accuracy for identifying enhancers and their strengths. Importantly, our analyses found that the distribution of bases in enhancers is uneven and the base G contents are more enriched, while the distribution of bases in non-enhancers is relatively even. This result contributes to the improvement of prediction performance and thus facilitates revealing an in-depth understanding of the potential functional mechanisms of enhancers. Author summary The enhancers contain many subspecies and the accuracy of existing models is difficult to improve due to the small data set. Motivated by the need for accurate and efficient methods to predict enhancer types, we developed a self-attention deep learning model iEnhancer-CLA, the aim is to be able to distinguish effectively and quickly between subspecies of enhancers and whether they are enhancers or not. The model is able to learn sequence features effectively through the combination of multi-scale CNN blocks, BLSTM layers, and self-attention mechanisms, thus improving the accuracy of the model. Encouragingly, by decoupling the CNN layer it was found that the layer was effective in learning the motif of the sequences, which in combination with the self-attention weights could provide interpretability to the model. We further performed sequence analysis in conjunction with the model-generated weights and discovered differences in enhancer and non-enhancer sequence characteristics. This phenomenon can be a guide for the construction of subsequent models for identifying enhancer sequences. ### Competing Interest Statement The authors have declared no competing interest.

iEnhancer-EL: identifying enhancers and their strength with ensemble learning approach.

iEnhancer-XG: interpretable sequence-based enhancers and their strength predictor

Ienhancer-Kl: A Novel Two-Layer Predictor for Identifying Enhancers by Position Specific of Nucleotide Composition

Ienhancer-2L: a Two-Layer Predictor for Identifying Enhancers and Their Strength by Pseudo K-Tuple Nucleotide Composition

Ienhancer-Mrbf: Identifying Enhancers and Their Strength with a Multiple Laplacian-regularized Radial Basis Function Network.

iEnhancer-SKNN: a stacking ensemble learning-based method for enhancer identification and classification using sequence information.

Ienhancer-Dcla: Using the Original Sequence to Identify Enhancers and Their Strength Based on a Deep Learning Framework

iEnhancer-DCSV: Predicting enhancers and their strength based on DenseNet and improved convolutional block attention module

A deep learning based two-layer predictor to identify enhancers and their strength

Ienhancer-Dlra: Identification of Enhancers and Their Strengths by a Self-Attention Fusion Strategy for Local and Global Features.

Integrative Machine Learning Framework for the Identification of Cell-Specific Enhancers from the Human Genome

iEnhancer-EBLSTM: Identifying Enhancers and Strengths by Ensembles of Bidirectional Long Short-Term Memory

Ienhancer-Psedeknc: Identification of Enhancers and Their Subgroups Based on Pseudo Degenerate Kmer Nucleotide Composition

iEnhancer-ELM: improve enhancer identification by extracting position-related multiscale contextual information based on enhancer language models

Ienhancer-Dcsa: Identifying Enhancers Via Dual-Scale Convolution and Spatial Attention

SENIES: DNA Shape Enhanced Two-Layer Deep Learning Predictor for the Identification of Enhancers and Their Strength

Enhancer-FRL: Improved and Robust Identification of Enhancers and Their Activities Using Feature Representation Learning

Ienhancer-Dhf: Identification of Enhancers and Their Strengths Using Optimize Deep Neural Network with Multiple Features Extraction Methods

DeepEnhancer: Predicting Enhancers by Convolutional Neural Networks.

Identifying and Classifying Enhancers by Dinucleotide-Based Auto-Cross Covariance and Attention-Based Bi-LSTM

iEnhancer-CLA: Self-attention-based interpretable model for enhancers and their strength prediction