Quartet DNA reference materials and datasets for comprehensively evaluating germline variants calling performance

Luyao Ren,Xiaoke Duan,Lianghua Dong,Rui Zhang,Jingcheng Yang,Yuechen Gao,Rongxue Peng,Wanwan Hou,Yaqing Liu,Jingjing Li,Ying Yu,Naixin Zhang,Jun Shang,Fan Liang,Depeng Wang,Hui Chen,Lele Sun,Lingtong Hao,The Quartet Project Team,Andreas Scherer,Jessica Nordlund,Wenming Xiao,Joshua Xu,Weida Tong,Xin Hu,Peng Jia,Kai Ye,Jinming Li,Li Jin,Leming Shi,Huixiao Hong,Jing Wang,Shaohua Fan,Xiang Fang,Yuanting Zheng
DOI: https://doi.org/10.1101/2022.09.28.509844
IF: 17.906
2022-01-01
Genome Biology
Abstract:Current methods for evaluating the accuracy of germline variant calls are restricted to easy-to-detect high-confidence regions, thus ignoring a substantial portion of difficult variants beyond the benchmark regions. We established four DNA reference materials from immortalized cell lines derived from a Chinese Quartet including parents and monozygotic twins. We integrated benchmark calls of 4.2 million small variants and 15,000 structural variants from multiple platforms and bioinformatic pipelines for evaluating the reliability of germline variant calls inside the benchmark regions. The genetic built-in-truth of the Quartet family design not only improved sensitivity of benchmark calls by removing additional false positive variants with apparently high quality, but also enabled estimation of the precision of variants calls outside the benchmark regions. Batch effects of variant calling in large-scale DNA sequencing efforts can be effectively identified with the concurrent use of the Quartet DNA reference materials along with study samples, and can be alleviated by training a machine learning model with the Quartet reference datasets to remove potential artifact calls. Matched RNA and protein reference materials were also established in the Quartet project, thereby enabling benchmark calls constructed from DNA reference materials for evaluation of variants calling performance on RNA and protein data. The Quartet DNA reference materials from this study are a resource for objective and comprehensive assessment of the accuracy of germline variant calls throughout the whole-genome regions. ### Competing Interest Statement The authors have declared no competing interest.
What problem does this paper attempt to address?