Abstract:MotivationThe rapid development of next-generation sequencing technology provides an opportunity to study genome-wide DNA methylation at single-base resolution. However, depletion of unmethylated cytosines brings challenges for aligning bisulfite-converted sequencing reads to a large reference. Software tools for aligning methylation reads have not yet been comprehensively evaluated, especially for the widely used reduced representation bisulfite sequencing (RRBS) that involves enrichment for CpG islands (CGIs).ResultsWe specially developed a simulator, RRBSsim, for benchmarking analysis of RRBS data. We performed extensive comparison of seven mapping algorithms for methylation analysis in both real and simulated RRBS data. Eighteen lung tumors and matched adjacent tissues were sequenced by the RRBS protocols. Our empirical evaluation found that methylation results were less consistent between software tools for CpG sites with low sequencing depth, medium methylation level, on CGI shores or gene body. These observations were further confirmed by simulations that indicated software tools generally had lower recall of detecting these vulnerable CpG sites and lower precision of estimating methylation levels in these CpG sites. Among the software tools tested, bwa-meth and BS-Seeker2 (bowtie2) are currently our preferred aligners for RRBS data in terms of recall, precision and speed. Existing aligners cannot efficiently handle moderately methylated CpG sites and those CpG sites on CGI shores or gene body. Interpretation of methylation results from these vulnerable CpG sites should be treated with caution. Our study reveals several important features inherent in methylation data, and RRBSsim provides guidance to advance sequence-based methylation data analysis and methodological development.Availability and implementationRRBSsim is a simulator for benchmarking analysis of RRBS data and its source code is available at https://github.com/xwBio/RRBSsim or https://github.com/xwBio/Docker-RRBSsim.Supplementary informationSupplementary data are available at Bioinformatics online.

Enhancing RNA-seq analysis by addressing all co-existing biases using a self-benchmarking approach with 2D structural insights

Enhancing RNA-seq bias mitigation with the Gaussian self-benchmarking framework: towards unbiased sequencing data

Critical view on oligo(dT)-based RNA-seq: bias arising, modeling, and mitigating

A Comprehensive Evaluation of Alignment Software for Reduced Representation Bisulfite Sequencing Data

A Real-World Multi-Center RNA-seq Benchmarking Study Using the Quartet and MAQC Reference Materials

A test metric for assessing single-cell RNA-seq batch correction

Assessment of batch-correction methods for scRNA-seq data with a new test metric

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

Optimal distance metrics for single-cell RNA-seq populations

Toward Best Practice in Identifying Subtle Differential Expression with RNA-seq: A Real-World Multi-Center Benchmarking Study Using Quartet and MAQC Reference Materials

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

BS-RNA: An efficient mapping and annotation tool for RNA bisulfite sequencing data

A Bias-Reducing Strategy in Profiling Small RNAs Using Solexa.

QNB: differential RNA methylation analysis for count-based small-sample sequencing data with a quad-negative binomial model

Benchmarking of RNA-sequencing analysis workflows using whole-transcriptome RT-qPCR expression data

Statistical Modeling of RNA-Seq Data

Low-cost, Low-bias and Low-input RNA-seq with High Experimental Verifiability Based on Semiconductor Sequencing

Fleximer: Accurate Quantification of RNA-Seq via Variable-Length k-mers

Systematic assessment of long-read RNA-seq methods for transcript identification and quantification

Using non-uniform read distribution models to improve isoform expression inference in RNA-Seq.

A Unified Statistical Framework for Single Cell and Bulk RNA Sequencing Data