Abstract:Background: Circular RNAs (circRNAs) play a significant role in some diseases by acting as transcription templates. Therefore, analyzing the interaction mechanism between circRNA and RNA-binding proteins (RBPs) has far-reaching implications for the prevention and treatment of diseases. Existing models for circRNA-RBP identification usually adopt convolution neural network (CNN), recurrent neural network (RNN), or their variants as feature extractors. Most of them have drawbacks such as poor parallelism, insufficient stability, and inability to capture long-term dependencies. Methods: In this paper, we propose a new method completely using the self-attention mechanism to capture deep semantic features of RNA sequences. On this basis, we construct a CircSSNN model for the cirRNA-RBP identification. The proposed model constructs a feature scheme by fusing circRNA sequence representations with statistical distributions, static local contexts, and dynamic global contexts. With a stable and efficient network architecture, the distance between any two positions in a sequence is reduced to a constant, so CircSSNN can quickly capture the long-term dependencies and extract the deep semantic features. Results: Experiments on 37 circRNA datasets show that the proposed model has overall advantages in stability, parallelism, and prediction performance. Keeping the network structure and hyperparameters unchanged, we directly apply the CircSSNN to linRNA datasets. The favorable results show that CircSSNN can be transformed simply and efficiently without task-oriented tuning. Conclusions: In conclusion, CircSSNN can serve as an appealing circRNA-RBP identification tool with good identification performance, excellent scalability, and wide application scope without the need for task-oriented fine-tuning of parameters, which is expected to reduce the professional threshold required for hyperparameter tuning in bioinformatics analysis.

A Representation Learning Approach for Predicting circRNA Back-Splicing Event via Sequence-Interaction-Aware Dual Encoder

JEDI: Circular RNA Prediction Based on Junction Encoders and Deep Interaction among Splice Sites.

SSCRB: Predicting circRNA-RBP interaction sites using a sequence and structural feature-based attention model

Predicting circRNA-RBP Binding Sites Using a Hybrid Deep Neural Network

A feature extraction method based on noise reduction for circRNA-miRNA interaction prediction combining multi-structure features in the association networks

CRBPDL: Identification of circRNA-RBP interaction sites using an ensemble neural network approach

Recent Progress of Deep Learning Methods for RBP Binding Sites Prediction on Circrna

KS-CMI: A circRNA-miRNA Interaction Prediction Method Based on the Signed Graph Neural Network and Denoising Autoencoder

CIRI‐Deep Enables Single‐Cell and Spatial Transcriptomic Analysis of Circular RNAs with Deep Learning

Bi-SGTAR: A simple yet efficient model for circRNA-disease association prediction based on known association pair only

Collaborative deep learning improves disease-related circRNA prediction based on multi-source functional information

CRBPSA: CircRNA-RBP interaction sites identification using sequence structural attention model

CircSSNN: circRNA-binding site prediction via sequence self-attention neural networks with pre-normalization

CRIP: predicting circRNA–RBP-binding sites using a codon-based encoding and hybrid deep neural networks

A machine learning framework based on multi-source feature fusion for circRNA-disease association prediction

Double matrix completion for circRNA-disease association prediction

CRIECNN: Ensemble convolutional neural network and advanced feature extraction methods for the precise forecasting of circRNA-RBP binding sites

iCRBP-LKHA: Large convolutional kernel and hybrid channel-spatial attention for identifying circRNA-RBP interaction sites

Deep learning and ensemble deep learning for circRNA-RBP interaction prediction in the last decade: A review

CircCNNs, a convolutional neural network framework to better understand the biogenesis of exonic circRNAs