Abstract:Background: Decoding human genomic sequences requires comprehensive analysis of DNA sequence functionality. Through computational and experimental approaches, researchers have studied the genotype-phenotype relationship and generate important datasets that help unravel complicated genetic blueprints. Thus, the recently developed artificial intelligence methods can be used to interpret the functions of those DNA sequences. Methods: This study explores the use of deep learning, particularly pre-trained genomic models like DNA_bert_6 and human_gpt2-v1, in interpreting and representing human genome sequences. Initially, we meticulously constructed multiple datasets linking genotypes and phenotypes to fine-tune those models for precise DNA sequence classification. Additionally, we evaluate the influence of sequence length on classification results and analyze the impact of feature extraction in the hidden layers of our model using the HERV dataset. To enhance our understanding of phenotype-specific patterns recognized by the model, we perform enrichment, pathogenicity and conservation analyzes of specific motifs in the human endogenous retrovirus (HERV) sequence with high average local representation weight (ALRW) scores. Results: We have constructed multiple genotype-phenotype datasets displaying commendable classification performance in comparison with random genomic sequences, particularly in the HERV dataset, which achieved binary and multi-classification accuracies and F1 values exceeding 0.935 and 0.888, respectively. Notably, the fine-tuning of the HERV dataset not only improved our ability to identify and distinguish diverse information types within DNA sequences but also successfully identified specific motifs associated with neurological disorders and cancers in regions with high ALRW scores. Subsequent analysis of these motifs shed light on the adaptive responses of species to environmental pressures and their co-evolution with pathogens. Conclusions: These findings highlight the potential of pre-trained genomic models in learning DNA sequence representations, particularly when utilizing the HERV dataset, and provide valuable insights for future research endeavors. This study represents an innovative strategy that combines pre-trained genomic model representations with classical methods for analyzing the functionality of genome sequences, thereby promoting cross-fertilization between genomics and artificial intelligence.

Exploring Functional Variant Using a Deep Learning Framework

DeepFormer: a hybrid network based on convolutional neural network and flow-attention mechanism for identifying the function of DNA sequences

Deep learning approaches for non-coding genetic variant effect prediction: current progress and future prospects

NCNet: Deep Learning Network Models for Predicting Function of Non-coding DNA

Predicting Functional Elements and Variants Effects in Non-Coding Regions Based on Deep Learning

Understanding structure-guided variant effect predictions using 3D convolutional neural networks

A semi-supervised deep learning approach for predicting the functional effects of genomic non-coding variations

Deep learning sequence-based ab initio prediction of variant effects on expression and disease risk

Prediction of disease-associated functional variants in noncoding regions through a comprehensive analysis by integrating datasets and features

PhosVarDeep: deep-learning based prediction of phospho-variants using sequence information

DeepATT: a hybrid category attention neural network for identifying functional effects of DNA sequences

Enhancing Gene Expression Predictions Using Deep Learning and Functional Annotations

Functional Neural Networks for High-Dimensional Genetic Data Analysis

Training deep learning models on personalized genomic sequences improves variant effect prediction

DYNA: Disease-Specific Language Model for Variant Pathogenicity

Multimodal learning of noncoding variant effects using genome sequence and chromatin structure

A Comparison on Predicting Functional Impact of Genomic Variants.

Enhancing recognition and interpretation of functional phenotypic sequences through fine-tuning pre-trained genomic models

Integration of deep learning with Ramachandran plot molecular dynamics simulation for genetic variant classification

Predicting Enhancers with Deep Convolutional Neural Networks

Accurate prediction of functional effect of single amino acid variants with deep learning