Abstract:Motivation: Segmental duplications (SDs) or low-copy repeats, are segments of DNA > 1 Kbp with high sequence identity that are copied to other regions of the genome. SDs are among the most important sources of evolution, a common cause of genomic structural variation and several are associated with diseases of genomic origin including schizophrenia and autism. Despite their functional importance, SDs present one of the major hurdles for de novo genome assembly due to the ambiguity they cause in building and traversing both state-of-the-art overlap-layout-consensus and de Bruijn graphs. This causes SD regions to be misassembled, collapsed into a unique representation, or completely missing from assembled reference genomes for various organisms. In turn, this missing or incorrect information limits our ability to fully understand the evolution and the architecture of the genomes. Despite the essential need to accurately characterize SDs in assemblies, there has been only one tool that was developed for this purpose, called Whole-Genome Assembly Comparison (WGAC); its primary goal is SD detection. WGAC is comprised of several steps that employ different tools and custom scripts, which makes this strategy difficult and time consuming to use. Thus there is still a need for algorithms to characterize within-assembly SDs quickly, accurately, and in a user friendly manner.Results: Here we introduce SEgmental Duplication Evaluation Framework (SEDEF) to rapidly detect SDs through sophisticated filtering strategies based on Jaccard similarity and local chaining. We show that SEDEF accurately detects SDs while maintaining substantial speed up over WGAC that translates into practical run times of minutes instead of weeks. Notably, our algorithm captures up to 25% 'pairwise error' between segments, whereas previous studies focused on only 10%, allowing us to more deeply track the evolutionary history of the genome.Availability and implementation: SEDEF is available at https://github.com/vpc-ccg/sedef.

Structural polymorphism and diversity of human segmental duplications

The evolution and population diversity of human-specific segmental duplications

Increased mutation and gene conversion within human segmental duplications

Segmental Duplications and Copy-Number Variation in the Human Genome

Copy Number Variants and Segmental Duplications Show Different Formation Signatures

Multi-platform Discovery of Haplotype-Resolved Structural Variation in Human Genomes

Paired-End Mapping Reveals Extensive Structural Variation in the Human Genome

Haplotype-resolved diverse human genomes and integrated analysis of structural variation

Fast characterization of segmental duplications in genome assemblies

The Structure of Simple Satellite Variation in the Human Genome and Its Correlation With Centromere Ancestry

Assessing structural variation in a personal genome—towards a human reference diploid genome

An Integrated Map of Structural Variation in 2,504 Human Genomes.

A high-quality reference panel reveals the complexity and distribution of structural genome changes in a human population

Large complex structural rearrangements in human genomes harbor cryptic structures

Patterns of Segmental Duplication in the Human Genome.

Mapping and sequencing of structural variation from eight human genomes

Global Diversity, Population Stratification, and Selection of Human Copy-Number Variation

Complex genetic variation in nearly complete human genomes

Scanning The Human Genome At Kilobase Resolution

Landscape of standing variation for tandem duplications in Drosophila yakuba and Drosophila simulans

A High-Quality Human Reference Panel Reveals the Complexity and Distribution of Genomic Structural Variants