Abstract:Background: Circular RNAs (circRNAs) play a significant role in some diseases by acting as transcription templates. Therefore, analyzing the interaction mechanism between circRNA and RNA-binding proteins (RBPs) has far-reaching implications for the prevention and treatment of diseases. Existing models for circRNA-RBP identification usually adopt convolution neural network (CNN), recurrent neural network (RNN), or their variants as feature extractors. Most of them have drawbacks such as poor parallelism, insufficient stability, and inability to capture long-term dependencies. Methods: In this paper, we propose a new method completely using the self-attention mechanism to capture deep semantic features of RNA sequences. On this basis, we construct a CircSSNN model for the cirRNA-RBP identification. The proposed model constructs a feature scheme by fusing circRNA sequence representations with statistical distributions, static local contexts, and dynamic global contexts. With a stable and efficient network architecture, the distance between any two positions in a sequence is reduced to a constant, so CircSSNN can quickly capture the long-term dependencies and extract the deep semantic features. Results: Experiments on 37 circRNA datasets show that the proposed model has overall advantages in stability, parallelism, and prediction performance. Keeping the network structure and hyperparameters unchanged, we directly apply the CircSSNN to linRNA datasets. The favorable results show that CircSSNN can be transformed simply and efficiently without task-oriented tuning. Conclusions: In conclusion, CircSSNN can serve as an appealing circRNA-RBP identification tool with good identification performance, excellent scalability, and wide application scope without the need for task-oriented fine-tuning of parameters, which is expected to reduce the professional threshold required for hyperparameter tuning in bioinformatics analysis.

Circ2cba: Prediction of Circrna-Rbp Binding Sites Combining Deep Learning and Attention Mechanism

Predicting Circrna-Rbp Interaction Sites Using a Codon-Based Encoding and Hybrid Deep Neural Networks

Predicting circRNA-RBP Binding Sites Using a Hybrid Deep Neural Network

CRBSP:Prediction of CircRNA-RBP Binding Sites Based on Multimodal Intermediate Fusion.

A Pseudo-Siamese Framework for Circrna-Rbp Binding Sites Prediction Integrating BiLSTM and Soft Attention Mechanism

An Encoding-Decoding Framework Based on CNN for Circrna-Rbp Binding Sites Prediction

Prediction of RBP Binding Sites on Circrnas Using an LSTM-based Deep Sequence Learning Architecture.

An Integrated TCN-CrossMHA Model for Predicting circRNA-RBP Binding Sites

CRBPDL: Identification of circRNA-RBP interaction sites using an ensemble neural network approach

CRIP: predicting circRNA–RBP-binding sites using a codon-based encoding and hybrid deep neural networks

iCRBP-LKHA: Large convolutional kernel and hybrid channel-spatial attention for identifying circRNA-RBP interaction sites

Recent Progress of Deep Learning Methods for RBP Binding Sites Prediction on Circrna

CircSSNN: circRNA-binding site prediction via sequence self-attention neural networks with pre-normalization

Recognizing Binding Sites of Poorly Characterized RNA-binding Proteins on Circular RNAs Using Attention Siamese Network

SSCRB: Predicting circRNA-RBP interaction sites using a sequence and structural feature-based attention model

CRBP-HFEF: Prediction of RBP-Binding Sites on Circrnas Based on Hierarchical Feature Expansion and Fusion.

Icircrbp-Dhn: Identification of Circrna-Rbp Interaction Sites Using Deep Hierarchical Network.

CRIECNN: Ensemble convolutional neural network and advanced feature extraction methods for the precise forecasting of circRNA-RBP binding sites

MSTCRB: Predicting circRNA-RBP interaction by extracting multi-scale features based on transformer and attention mechanism

CRMSS: Predicting Circrna-Rbp Binding Sites Based on Multi-Scale Characterizing Sequence and Structure Features.

CircSLNN: Identifying RBP-Binding Sites on circRNAs via Sequence Labeling Neural Networks.