Abstract:Background: Software for labeling biological sequences typically produces a theory-based statistic for each match (the E-value) that indicates the likelihood of seeing that match's score by chance. E-values accurately predict false match rate for comparisons of random (shuffled) sequences, and thus provide a reasoned mechanism for setting score thresholds that enable high sensitivity with low expected false match rate. This threshold-setting strategy is challenged by real biological sequences, which contain regions of local repetition and low sequence complexity that cause excess matches between non-homologous sequences. Knowing this, tool developers often develop benchmarks that use realistic-seeming decoy sequences to explore empirical tradeoffs between sensitivity and false match rate. A recent trend has been to employ reversed biological sequences as realistic decoys, because these preserve the distribution of letters and the existence of local repeats, while disrupting the original sequence's functional properties. However, we and others have observed that sequences appear to produce high scoring alignments to their reversals with surprising frequency, leading to overstatement of false match risk that may negatively affect downstream analysis. Results: We demonstrate that an alignment between a sequence S and its (possibly mutated) reversal tends to produce higher scores than alignment between truly unrelated sequences, even when S is a shuffled string with no notable repetitive or low-complexity regions. This phenomenon is due to the unintuitive fact that (even randomly shuffled) sequences contain palindromes that are on average longer than the longest common substrings (LCS) shared between permuted variants of the same sequence. Though the expected palindrome length is only slightly larger than the expected LCS, the distribution of alignment scores involving reversed sequences is strongly right-shifted, leading to greatly increased frequency of high-scoring alignments to reversed sequences. Impact: Overestimates of false match risk can motivate unnecessarily high score thresholds, leading to potentially reduced true match sensitivity. Also, when tool sensitivity is only reported up to the score of the first matched decoy sequence, a large decoy set consisting of reversed sequences can obscure sensitivity differences between tools. As a result of these observations, we advise that reversed biological sequences be used as decoys only when care is taken to remove positive matches in the original (un-reversed) sequences, or when overstatement of false labeling is not a concern. Though the primary focus of the analysis is on sequence annotation, we also demonstrate that the prevalence of internal palindromes may lead to an overstatement of the rate of false labels in protein identification with mass spectrometry.

Estimate the Occurrence Rate of the DNA Palindromes

Correlation Between GC-content and Palindromes in Randomly Generated Sequences and Viral Genomes

Fast Single-Stranded Desoxyribonucleic Acid Sequencing Between Polynucleotide Molecules

Statistical properties and fractals of nucleotide clusters in DNA sequences

Statistical Properties of Nucleotide Clusters in DNA Sequences

Long-range correlations in DNA sequences using 2D DNA walk based on pairs of sequential nucleotides

Statistical Properties of Nucleotides in Human Chromosomes 21 and 22

WAS IT A MATch I SAW? Approximate palindromes lead to overstated false match rates in benchmarks using reversed sequences

High nucleotide skew palindromic DNA sequences function as replication origins due to their unzipping propensity

Statistical method for testing the neutral mutation hypothesis by DNA polymorphism.

2D representations of DNA sequence show that most transversions are misaligned nucleotides associated with replication slippage.

A Combinatorial Perspective on Random Access Efficiency for DNA Storage

Palindromic Sequence Artifacts Generated during Next Generation Sequencing Library Preparation from Historic and Ancient DNA

Analysis of DNA sequences through local distribution of nucleotides in strategic neighborhoods

The Effect of the Length of Direct Repeats and the Presence of Palindromes on Deletion Between Directly Repeated DNA Sequences in Bacteriophage T7.

High-scale random access on DNA storage systems

Nondetectability of Restriction Fragments and Independence of Dna Fragment Sizes Within and Between Loci in Rflp Typing of Dna

Visualization of K-tuple Distribution in Procaryote Complete Genomes and Their Randomized Counterparts

New insights into the evolution of human Y chromosome palindromes through mutation and gene conversion

Mapping of DNA base-pair sequence from breathing dynamics of hetero-polymeric DNA: A genetic algorithm-based study

Accurate sequencing of DNA motifs able to form alternative structures