Abstract:MotivationThe rapid development of next-generation sequencing technology provides an opportunity to study genome-wide DNA methylation at single-base resolution. However, depletion of unmethylated cytosines brings challenges for aligning bisulfite-converted sequencing reads to a large reference. Software tools for aligning methylation reads have not yet been comprehensively evaluated, especially for the widely used reduced representation bisulfite sequencing (RRBS) that involves enrichment for CpG islands (CGIs).ResultsWe specially developed a simulator, RRBSsim, for benchmarking analysis of RRBS data. We performed extensive comparison of seven mapping algorithms for methylation analysis in both real and simulated RRBS data. Eighteen lung tumors and matched adjacent tissues were sequenced by the RRBS protocols. Our empirical evaluation found that methylation results were less consistent between software tools for CpG sites with low sequencing depth, medium methylation level, on CGI shores or gene body. These observations were further confirmed by simulations that indicated software tools generally had lower recall of detecting these vulnerable CpG sites and lower precision of estimating methylation levels in these CpG sites. Among the software tools tested, bwa-meth and BS-Seeker2 (bowtie2) are currently our preferred aligners for RRBS data in terms of recall, precision and speed. Existing aligners cannot efficiently handle moderately methylated CpG sites and those CpG sites on CGI shores or gene body. Interpretation of methylation results from these vulnerable CpG sites should be treated with caution. Our study reveals several important features inherent in methylation data, and RRBSsim provides guidance to advance sequence-based methylation data analysis and methodological development.Availability and implementationRRBSsim is a simulator for benchmarking analysis of RRBS data and its source code is available at https://github.com/xwBio/RRBSsim or https://github.com/xwBio/Docker-RRBSsim.Supplementary informationSupplementary data are available at Bioinformatics online.

Comparative analysis of common alignment tools for single-cell RNA sequencing

Comparative analysis of RNA-Seq alignment algorithms and the RNA-Seq unified mapper (RUM)

Systematic comparative analysis of single cell RNA-sequencing methods

Comparative Analysis of Commercial Single-Cell RNA Sequencing Technologies

Comparison of clustering tools in R for medium-sized 10x Genomics single-cell RNA-sequencing data

Systematic Comparative Analysis of Single-Nucleotide Variant Detection Methods from Single-Cell RNA Sequencing Data

Comparison of algorithms used in single-cell transcriptomic data analysis

Comparative Analysis of NovaSeq 6000 and MGISEQ 2000 Single-Cell RNA Sequencing Data.

A Comprehensive Evaluation of Alignment Software for Reduced Representation Bisulfite Sequencing Data

A comprehensive analysis framework for evaluating commercial single-cell RNA sequencing technologies

Comparison of Single Cell Transcriptome Sequencing Methods: Of Mice and Men

Direct Comparative Analyses of 10X Genomics Chromium and Smart-seq2

Limitations of Alignment-Free Tools in Total RNA-seq Quantification.

Evaluation of Seven Different RNA-Seq Alignment Tools Based on Experimental Data from the Model Plant Arabidopsis thaliana

Comparison of Scrna-Seq Data Analysis Method Combinations.

Benchmarking RNA-Seq Aligners at Base-Level and Junction Base-Level Resolution Using the Arabidopsis thaliana Genome

Comparative Analysis of Sequencing Technologies for Single-Cell Transcriptomics

A Strategy to Compare Single-Cell RNA Sequencing Data Sets Provides Phenotypic Insight into Cellular Heterogeneity Underlying Biological Similarities and Differences Between Samples

Illumina SBS Sequencing and DNBSEQ Perform Similarly for Single-Cell Transcriptomics

A Novel Multi-Alignment Pipeline for High-Throughput Sequencing Data.

A comprehensive benchmarking of differential splicing tools for RNA-seq analysis at the event level