Abstract:DNA methylation plays an important role in epigenetic modification, the occurrence, and the development of diseases. Therefore, identification of DNA methylation sites is critical for better understanding and revealing their functional mechanisms. To date, several machine learning and deep learning methods have been developed for the prediction of different DNA methylation types. However, they still highly rely on manual features, which can largely limit the high-latent information extraction. Moreover, most of them are designed for one specific DNA methylation type, and therefore cannot predict multiple methylation sites in multiple species simultaneously. In this study, we propose iDNA-ABT, an advanced deep learning model that utilizes adaptive embedding based on Bidirectional Encoder Representations from Transformers (BERT) together with transductive information maximization (TIM).Benchmark results show that our proposed iDNA-ABT can automatically and adaptively learn the distinguishing features of biological sequences from multiple species, and thus perform significantly better than the state-of-the-art methods in predicting three different DNA methylation types. In addition, TIM loss is proven to be effective in dichotomous tasks via the comparison experiment. Furthermore, we verify that our features have strong adaptability and robustness to different species through comparison of adaptive embedding and six handcrafted feature encodings. Importantly, our model shows great generalization ability in different species, demonstrating that our model can adaptively capture the cross-species differences and improve the predictive performance. For the convenient use of our method, we further established an online webserver as the implementation of the proposed iDNA-ABT.Our proposed iDNA-ABT and data are freely accessible via http://server.wei-group.net/iDNA_ABT and our source codes are available for downloading in the GitHub repository (https://github.com/YUYING07/iDNA_ABT).Supplementary data are available at Bioinformatics online.

Idna-Abf: Multi-Scale Deep Biological Language Learning Model for the Interpretable Prediction of DNA Methylations

Idna-Abt: Advanced Deep Learning Model for Detecting DNA Methylation with Adaptive Features and Transductive Information Maximization

Idna-Itlm: an Interpretable and Transferable Learning Model for Identifying DNA Methylation

Interpretable Multi-Scale Deep Learning for RNA Methylation Analysis across Multiple Species

Predicting the sequence specificities of DNA-binding proteins by DNA Fine-tuned Language Model with decaying learning rates

Deciphering the Language of Protein-DNA Interactions: A Deep Learning Approach Combining Contextual Embeddings and Multi-Scale Sequence Modeling

iResNetDM: An interpretable deep learning approach for four types of DNA methylation modification prediction

DeepPGD: A Deep Learning Model for DNA Methylation Prediction Using Temporal Convolution, BiLSTM, and Attention Mechanism

MuLan-Methyl-multiple transformer-based language models for accurate DNA methylation prediction

StableDNAm: towards a stable and efficient model for predicting DNA methylation based on adaptive feature correction learning

DeepMethylation: a deep learning based framework with GloVe and Transformer encoder for DNA methylation prediction

Predicting DNA Methylation States with Hybrid Information Based Deep-Learning Model

DeepSF-4mC: A Deep Learning Model for Predicting DNA Cytosine 4mc Methylation Sites Leveraging Sequence Features.

Developing a Multi-Layer Deep Learning Based Predictive Model to Identify DNA N4-Methylcytosine Modifications

Distinguishing word identity and sequence context in DNA language models

Deep Learning Based Method for Predicting DNA N6-methyladenosine Sites.

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

Benchmarking DNA Foundation Models for Genomic Sequence Classification

Comparative evaluation and analysis of DNA N4-methylcytosine methylation sites using deep learning

EpiTEAmDNA: Sequence feature representation via transfer learning and ensemble learning for identifying multiple DNA epigenetic modification types across species