Abstract:Abstract Background Accurate variant detection in the coding regions of the human genome is a key requirement for molecular diagnostics of Mendelian disorders. Efficiency of variant discovery from next-generation sequencing (NGS) data depends on multiple factors, including reproducible coverage biases of NGS methods and the performance of read alignment and variant calling software. Although variant caller benchmarks are published constantly, no previous publications have leveraged the full extent of available gold standard whole-genome (WGS) and whole-exome (WES) sequencing datasets. Results In this work, we systematically evaluated the performance of 4 popular short read aligners (Bowtie2, BWA, Isaac, and Novoalign) and 9 novel and well-established variant calling and filtering methods (Clair3, DeepVariant, Octopus, GATK, FreeBayes, and Strelka2) using a set of 14 “gold standard” WES and WGS datasets available from Genome In A Bottle (GIAB) consortium. Additionally, we have indirectly evaluated each pipeline’s performance using a set of 6 non-GIAB samples of African and Russian ethnicity. In our benchmark, Bowtie2 performed significantly worse than other aligners, suggesting it should not be used for medical variant calling. When other aligners were considered, the accuracy of variant discovery mostly depended on the variant caller and not the read aligner. Among the tested variant callers, DeepVariant consistently showed the best performance and the highest robustness. Other actively developed tools, such as Clair3, Octopus, and Strelka2, also performed well, although their efficiency had greater dependence on the quality and type of the input data. We have also compared the consistency of variant calls in GIAB and non-GIAB samples. With few important caveats, best-performing tools have shown little evidence of overfitting. Conclusions The results show surprisingly large differences in the performance of cutting-edge tools even in high confidence regions of the coding genome. This highlights the importance of regular benchmarking of quickly evolving tools and pipelines. We also discuss the need for a more diverse set of gold standard genomes that would include samples of African, Hispanic, or mixed ancestry. Additionally, there is also a need for better variant caller assessment in the repetitive regions of the coding genome.

Systematic dissection of biases in whole-exome and whole-genome sequencing reveals major determinants of coding sequence coverage

Systematic benchmark of state-of-the-art variant calling pipelines identifies major factors affecting accuracy of coding sequence variant discovery

DNA copy number analysis of fresh and formalin-fixed specimens by shallow whole-genome sequencing with identification and exclusion of problematic regions in the genome assembly

Review of Current Methods, Applications, and Data Management for the Bioinformatics Analysis of Whole Exome Sequencing

Evaluation of whole exome sequencing as an alternative to BeadChip and whole genome sequencing in human population genetic analysis

Enhancing Clinical Applications by Evaluation of Sensitivity and Specificity in Whole Exome Sequencing

An evaluation of copy number variation detection tools from whole-exome sequencing data.

A cost-effective sequencing method for genetic studies combining high-depth whole exome and low-depth whole genome

Comprehensive Outline of Whole Exome Sequencing Data Analysis Tools Available in Clinical Oncology

One Size Doesn't Fit All - RefEditor: Building Personalized Diploid Reference Genome to Improve Read Mapping and Genotype Calling in Next Generation Sequencing Studies.

Enhancing Variant Calling in Whole-Exome Sequencing Data Using Population-Matched Reference Genomes.

Whole-genome sequencing is more powerful than whole-exome sequencing for detecting exome variants

Enhancing Variant Calling in Whole Exome Sequencing (WES) Data Using Population-Matched Reference Genomes

Comprehensive Comparison of Three Commercial Human Whole-Exome Capture Platforms

Hidden Biases in Germline Structural Variant Detection.

Using Off-Target Data from Whole-Exome Sequencing to Improve Genotyping Accuracy, Association Analysis and Polygenic Risk Prediction.

A New Massively Parallel Nanoball Sequencing Platform for Whole Exome Research

Comparative evaluation of four exome enrichment solutions in 2024: Agilent, Roche, Vazyme and Nanodigmbio

Identification of copy number variants in whole-genome data using Reference Coverage Profiles

Variant calling pipelines for whole exome sequencing in clinical context

An evaluation of sequencing coverage and genotyping strategies to assess neutral and adaptive diversity