Abstract:DNA methylation plays an important role in epigenetic modification, the occurrence, and the development of diseases. Therefore, identification of DNA methylation sites is critical for better understanding and revealing their functional mechanisms. To date, several machine learning and deep learning methods have been developed for the prediction of different DNA methylation types. However, they still highly rely on manual features, which can largely limit the high-latent information extraction. Moreover, most of them are designed for one specific DNA methylation type, and therefore cannot predict multiple methylation sites in multiple species simultaneously. In this study, we propose iDNA-ABT, an advanced deep learning model that utilizes adaptive embedding based on Bidirectional Encoder Representations from Transformers (BERT) together with transductive information maximization (TIM).Benchmark results show that our proposed iDNA-ABT can automatically and adaptively learn the distinguishing features of biological sequences from multiple species, and thus perform significantly better than the state-of-the-art methods in predicting three different DNA methylation types. In addition, TIM loss is proven to be effective in dichotomous tasks via the comparison experiment. Furthermore, we verify that our features have strong adaptability and robustness to different species through comparison of adaptive embedding and six handcrafted feature encodings. Importantly, our model shows great generalization ability in different species, demonstrating that our model can adaptively capture the cross-species differences and improve the predictive performance. For the convenient use of our method, we further established an online webserver as the implementation of the proposed iDNA-ABT.Our proposed iDNA-ABT and data are freely accessible via http://server.wei-group.net/iDNA_ABT and our source codes are available for downloading in the GitHub repository (https://github.com/YUYING07/iDNA_ABT).Supplementary data are available at Bioinformatics online.

Enhanced 5mC-Methylation-Site Recognition in DNA Sequences using Token Classification and a Domain-specific Loss Function

MuLan-Methyl-multiple transformer-based language models for accurate DNA methylation prediction

DeepMethylation: a deep learning based framework with GloVe and Transformer encoder for DNA methylation prediction

A Novel Computational Method For Detecting Dna Methylation Sites With Dna Sequence Information And Physicochemical Properties

BiLSTM-5mC: A Bidirectional Long Short-Term Memory-Based Approach for Predicting 5-Methylcytosine Sites in Genome-Wide DNA Promoters

DeepPGD: A Deep Learning Model for DNA Methylation Prediction Using Temporal Convolution, BiLSTM, and Attention Mechanism

MRCNN: a Deep Learning Model for Regression of Genome-Wide DNA Methylation

PSATF-6mA: an integrated learning fusion feature-encoded DNA-6 mA methylcytosine modification site recognition model based on attentional mechanisms

Predicting Differentially Methylated Cytosines in TET and DNMT3 Knockout Mutants via a Large Language Model

Wemics: A Single‐Base Resolution Methylation Quantification Method for Enhanced Prediction of Epigenetic Regulation

MethylQUEEN: A Methylation Encoded DNA Foundation Model

DeepSF-4mC: A Deep Learning Model for Predicting DNA Cytosine 4mc Methylation Sites Leveraging Sequence Features.

Deep Learning Based Method for Predicting DNA N6-methyladenosine Sites.

BERT-5mC: an interpretable model for predicting 5-methylcytosine sites of DNA based on BERT

MaskDNA-PGD: An innovative deep learning model for detecting DNA methylation by integrating mask sequences and adversarial PGD training as a data augmentation method

Leveraging the attention mechanism to improve the identification of DNA N6-methyladenine sites

Idna-Abt: Advanced Deep Learning Model for Detecting DNA Methylation with Adaptive Features and Transductive Information Maximization

4Mcpred-Mtl: Accurate Identification of DNA 4mc Sites in Multiple Species Using Multi-Task Deep Learning Based on Multi-Head Attention Mechanism.

Predicting the effect of non-coding mutations on single-cell DNA methylation using deep learning

EpiTEAmDNA: Sequence feature representation via transfer learning and ensemble learning for identifying multiple DNA epigenetic modification types across species

Predicting DNA Methylation States with Hybrid Information Based Deep-Learning Model