Abstract:MotivationThe rapid development of next-generation sequencing technology provides an opportunity to study genome-wide DNA methylation at single-base resolution. However, depletion of unmethylated cytosines brings challenges for aligning bisulfite-converted sequencing reads to a large reference. Software tools for aligning methylation reads have not yet been comprehensively evaluated, especially for the widely used reduced representation bisulfite sequencing (RRBS) that involves enrichment for CpG islands (CGIs).ResultsWe specially developed a simulator, RRBSsim, for benchmarking analysis of RRBS data. We performed extensive comparison of seven mapping algorithms for methylation analysis in both real and simulated RRBS data. Eighteen lung tumors and matched adjacent tissues were sequenced by the RRBS protocols. Our empirical evaluation found that methylation results were less consistent between software tools for CpG sites with low sequencing depth, medium methylation level, on CGI shores or gene body. These observations were further confirmed by simulations that indicated software tools generally had lower recall of detecting these vulnerable CpG sites and lower precision of estimating methylation levels in these CpG sites. Among the software tools tested, bwa-meth and BS-Seeker2 (bowtie2) are currently our preferred aligners for RRBS data in terms of recall, precision and speed. Existing aligners cannot efficiently handle moderately methylated CpG sites and those CpG sites on CGI shores or gene body. Interpretation of methylation results from these vulnerable CpG sites should be treated with caution. Our study reveals several important features inherent in methylation data, and RRBSsim provides guidance to advance sequence-based methylation data analysis and methodological development.Availability and implementationRRBSsim is a simulator for benchmarking analysis of RRBS data and its source code is available at https://github.com/xwBio/RRBSsim or https://github.com/xwBio/Docker-RRBSsim.Supplementary informationSupplementary data are available at Bioinformatics online.

Enhancing RNA-seq bias mitigation with the Gaussian self-benchmarking framework: towards unbiased sequencing data

Enhancing RNA-seq analysis by addressing all co-existing biases using a self-benchmarking approach with 2D structural insights

Critical view on oligo(dT)-based RNA-seq: bias arising, modeling, and mitigating

The impact of RNA secondary structure on read start locations on the Illumina sequencing platform

A Comprehensive Evaluation of Alignment Software for Reduced Representation Bisulfite Sequencing Data

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

Degps is a Powerful Tool for Detecting Differential Expression in RNA-sequencing Studies

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

BS-RNA: An efficient mapping and annotation tool for RNA bisulfite sequencing data

A Real-World Multi-Center RNA-seq Benchmarking Study Using the Quartet and MAQC Reference Materials

Quantifying molecular bias in DNA data storage

A Bias-Reducing Strategy in Profiling Small RNAs Using Solexa.

RNA-SeQC: RNA-seq metrics for quality control and process optimization

A Unified Statistical Framework for Single Cell and Bulk RNA Sequencing Data

Improved TGIRT-seq Methods for Comprehensive Transcriptome Profiling with Decreased Adapter Dimer Formation and Bias Correction

IVT-seq reveals extreme bias in RNA sequencing

Correcting 4sU induced quantification bias in nucleotide conversion RNA-seq data

Toward Best Practice in Identifying Subtle Differential Expression with RNA-seq: A Real-World Multi-Center Benchmarking Study Using Quartet and MAQC Reference Materials

The shaky foundations of simulating single-cell RNA sequencing data

Using non-uniform read distribution models to improve isoform expression inference in RNA-Seq.

SimCH: simulation of single-cell RNA sequencing data by modeling cellular heterogeneity at gene expression level