Abstract:Non-coding variants associated with complex traits can alter the motifs of transcription factor (TF)–deoxyribonucleic acid binding. Although many computational models have been developed to predict the effects of non-coding variants on TF binding, their predictive power lacks systematic evaluation. Here we have evaluated 14 different models built on position weight matrices (PWMs), support vector machines, ordinary least squares and deep neural networks (DNNs), using large-scale in vitro (i.e. SNP-SELEX) and in vivo (i.e. allele-specific binding, ASB) TF binding data. Our results show that the accuracy of each model in predicting SNP effects in vitro significantly exceeds that achieved in vivo . For in vitro variant impact prediction, kmer/gkm-based machine learning methods (deltaSVM_HT-SELEX, QBiC-Pred) trained on in vitro datasets exhibit the best performance. For in vivo ASB variant prediction, DNN-based multitask models (DeepSEA, Sei, Enformer) trained on the ChIP-seq dataset exhibit relatively superior performance. Among the PWM-based methods, tRap demonstrates better performance in both in vitro and in vivo evaluations. In addition, we find that TF classes such as basic leucine zipper factors could be predicted more accurately, whereas those such as C2H2 zinc finger factors are predicted less accurately, aligning with the evolutionary conservation of these TF classes. We also underscore the significance of non-sequence factors such as cis -regulatory element type, TF expression, interactions and post-translational modifications in influencing the in vivo predictive performance of TFs. Our research provides valuable insights into selecting prioritization methods for non-coding variants and further optimizing such models.

The evaluation of transcription factor binding site prediction tools in human and Arabidopsis genomes

Evaluating tools for transcription factor binding site prediction

Comprehensive analysis of computational approaches in plant transcription factors binding regions discovery

TSPTFBS 2.0: Trans-Species Prediction of Transcription Factor Binding Sites and Identification of Their Core Motifs in Plants.

A Novel Method for Improved Accuracy of Transcription Factor Binding Site Prediction

Advances on Bioinformatic Research in Transcription Factor Binding Sites

Prediction Of Transcription Factor Binding Sites Using Genetic Algorithm

TF2Network: predicting transcription factor regulators and gene regulatory networks in Arabidopsis using publicly available binding site information

Computational Prediction of Transcription Factor Binding Sites Based on HMM Model and Information Content

Predicting Transcription Factor Binding Sites in a Yeast Genome

Template-Based Structure Prediction And Classification Of Transcription Factors In Arabidopsis Thaliana

TSPTFBS: a Docker image for trans-species prediction of transcription factor binding sites in plants

Evolutionary optimization of transcription factor binding motif detection

PlantBind: an attention-based multi-label neural network for predicting plant transcription factor binding sites

Transcription Factor Binding Site Discovery Based on New Bayesian Scoring Schema

Building Transcription Factor Binding Site Models to Understand Gene Regulation in Plants

Predicting transcription factor binding motifs from DNA-binding domains, chromatin accessibility and gene expression data

Recognition of the Transcription Factor Binding Sites in Escherichia Coli K-12

Comparative analysis of models in predicting the effects of SNPs on TF-DNA binding using large-scale in vitro and in vivo data

Predicting Tissue Specific Transcription Factor Binding Sites

PTFSpot: Deep co-learning on transcription factors and their binding regions attains impeccable universality in plants