Constructing a genome assembly that has the maximum likelihood

Mohammadreza Ghodsi

DOI: https://doi.org/10.48550/arXiv.1302.4391

2016-04-07

Abstract:We formulate genome assembly problem as an optimization problem in which the objective function is the likelihood of the assembly given the reads.

Computational Engineering, Finance, and Science,Data Structures and Algorithms

What problem does this paper attempt to address?

Maximum likelihood genome assembly

Paul Medvedev,Michael Brudno

DOI: https://doi.org/10.1089/cmb.2009.0047

Abstract:Whole genome shotgun assembly is the process of taking many short sequenced segments (reads) and reconstructing the genome from which they originated. We demonstrate how the technique of bidirected network flow can be used to explicitly model the double-stranded nature of DNA for genome assembly. By combining an algorithm for the Chinese Postman Problem on bidirected graphs with the construction of a bidirected de Bruijn graph, we are able to find the shortest double-stranded DNA sequence that contains a given set of k-long DNA molecules. This is the first exact polynomial time algorithm for the assembly of a double-stranded genome. Furthermore, we propose a maximum likelihood framework for assembling the genome that is the most likely source of the reads, in lieu of the standard maximum parsimony approach (which finds the shortest genome subject to some constraints). In this setting, we give a bidirected network flow-based algorithm that, by taking advantage of high coverage, accurately estimates the copy counts of repeats in a genome. Our second algorithm combines these predicted copy counts with matepair data in order to assemble the reads into contigs. We run our algorithms on simulated read data from Escherichia coli and predict copy counts with extremely high accuracy, while assembling long contigs.
Minimize Maximum Coverage of Fragment Alignment Selection.

Yuyang Wang,Haitao Jiang,Haodi Feng,Daming Zhu

DOI: https://doi.org/10.1109/BIBM58861.2023.10385667

2023-01-01

Abstract:In genome/transcriptome assembly and similar scenarios, we are usually given millions of fragments and ready to assemble them into longer contigs by first aligning them to a reference sequence. Since one fragment may be aligned to different locations due to sequence repetition, mutation, and artificial factors the alignment tools concern, users of alignment tools must make their own strategies for choosing one location for each fragment. Commonly used strategies usually assign the same value for each location or assign values according to alignment scores without taking into account the optimization. Considering that a reasonable strategy should ensure that the coverage at each base is similar, we depict the problem of assigning fragments to properly aligned positions as an optimization problem that minimizes the maximum coverage over all bases, studying the computational complexities for some cases and designing polynomial-time or approximate polynomial-time algorithms for them and some others.
HyDA-Vista: towards optimal guided selection of k-mer size for sequence assembly

Basir Shariat,Narjes Sadat Movahedi,Hamidreza Chitsaz,Christina Boucher

DOI: https://doi.org/10.1186/1471-2164-15-s10-s9

IF: 4.547

2014-12-01

BMC Genomics

Abstract:MotivationIntimately tied to assembly quality is the complexity of the de Bruijn graph built by the assembler. Thus, there have been many paradigms developed to decrease the complexity of the de Bruijn graph. One obvious combinatorial paradigm for this is to allow the value of k to vary; having a larger value of k where the graph is more complex and a smaller value of k where the graph would likely contain fewer spurious edges and vertices. One open problem that affects the practicality of this method is how to predict the value of k prior to building the de Bruijn graph. We show that optimal values of k can be predicted prior to assembly by using the information contained in a phylogenetically-close genome and therefore, help make the use of multiple values of k practical for genome assembly.ResultsWe present HyDA-Vista, which is a genome assembler that uses homology information to choose a value of k for each read prior to the de Bruijn graph construction. The chosen k is optimal if there are no sequencing errors and the coverage is sufficient. Fundamental to our method is the construction of the maximal sequence landscape, which is a data structure that stores for each position in the input string, the largest repeated substring containing that position. In particular, we show the maximal sequence landscape can be constructed in O(n + n log n)-time and O(n)-space. HyDA-Vista first constructs the maximal sequence landscape for a homologous genome. The reads are then aligned to this reference genome, and values of k are assigned to each read using the maximal sequence landscape and the alignments. Eventually, all the reads are assembled by an iterative de Bruijn graph construction method. Our results and comparison to other assemblers demonstrate that HyDA-Vista achieves the best assembly of E. coli before repeat resolution or scaffolding.AvailabilityHyDA-Vista is freely available [1]. The code for constructing the maximal sequence landscape and choosing the optimal value of k for each read is also separately available on the website and could be incorporated into any genome assembler.

genetics & heredity,biotechnology & applied microbiology
Near-optimal Assembly for Shotgun Sequencing with Noisy Reads

Ka-Kit Lam,Asif Khalak,David Tse

DOI: https://doi.org/10.48550/arXiv.1402.6971

2014-02-28

Abstract:Recent work identified the fundamental limits on the information requirements in terms of read length and coverage depth required for successful de novo genome reconstruction from shotgun sequencing data, based on the idealistic assumption of no errors in the reads (noiseless reads). In this work, we show that even when there is noise in the reads, one can successfully reconstruct with information requirements close to the noiseless fundamental limit. A new assembly algorithm, X-phased Multibridging, is designed based on a probabilistic model of the genome. It is shown through analysis to perform well on the model, and through simulations to perform well on real genomes.

Genomics
Theoretical Bounds on Mate-Pair Information for Accurate Genome Assembly

Henry Lin

DOI: https://doi.org/10.48550/arXiv.1310.1653

IF: 4.31

2013-10-07

Genomics

Abstract:Over the past two decades, a series of works have aimed at studying the problem of genome assembly: the process of reconstructing a genome from sequence reads. An early formulation of the genome assembly problem showed that genome reconstruction is NP-hard when framed as finding the shortest sequence that contains all observed reads. Although this original formulation is very simplistic and does not allow for mate-pair information, subsequent formulations have also proven to be NP-hard, and/or may not be guaranteed to return a correct assembly. In this paper, we provide an alternate perspective on the genome assembly problem by showing genome assembly is easy when provided with sufficient mate-pair information. Moreover, we quantify the number of mate-pair libraries necessary and sufficient for accurate genome assembly, in terms of the length of the longest repetitive region within a genome. In our analysis, we consider an idealized sequencing model where each mate-pair library generates pairs of error free reads with a fixed and known insert size at each position in the genome. Even in this idealized model, we show that accurate genome reconstruction cannot be guaranteed in the worst case unless at least roughly R/2L mate-pair libraries are produced, where R is the length of the longest repetitive region in the genome and L is the length of each read. On the other hand, if (R/L)+1 mate-pair libraries are provided, then a simple algorithm can be used to find a correct genome assembly easily in polynomial time. Although (R/L)+1 mate-pair libraries can be too much to produce in practice, the previous bounds only hold in the worst case. In our last result, we show that if additional conditions hold on a genome, a correct assembly can be guaranteed with only O(log (R/L)) mate-pair libraries.
Bayesian genome assembly and assessment by Markov Chain Monte Carlo sampling

Mark Howison,Felipe Zapata,Erika J. Edwards,Casey W. Dunn

DOI: https://doi.org/10.1371/journal.pone.0099497

2013-10-15

Abstract:Most genome assemblers construct point estimates, choosing a genome sequence from among many alternative hypotheses that are supported by the data. We present a Markov Chain Monte Carlo approach to sequence assembly that instead generates distributions of assembly hypotheses with posterior probabilities, providing an explicit statistical framework for evaluating alternative hypotheses and assessing assembly uncertainty. We implement this approach in a prototype assembler and illustrate its application to the bacteriophage PhiX174.

Genomics
Efficient High-Quality Metagenome Assembly from Long Accurate Reads using Minimizer-space de Bruijn Graphs

Gaëtan Benoit,Sébastien Raguideau,Robert James,Adam M. Phillippy,Rayan Chikhi,Christopher Quince,Benoit,G.,Raguideau,S.,James,R.,Phillippy,A. M.,Chikhi,R.,Quince,C.

DOI: https://doi.org/10.1101/2023.07.07.548136

2023-07-09

bioRxiv

Abstract:We introduce a novel metagenomics assembler for high-accuracy long reads. Our approach, implemented as metaMDBG, combines highly efficient de Bruijn graph assembly in minimizer space, with both a multi-k' approach for dealing with variations in genome coverage depth and an abundance-based filtering strategy for simplifying strain complexity. The resulting algorithm is more efficient than the state-of-the-art but with better assembly results. MetaMDBG was 1.5 to 12 times faster than competing assemblers and requires between one-tenth and one-thirtieth of the memory across a range of data sets. We obtained up to twice as many high-quality circularised prokaryotic metagenome assembled genomes (MAGs) on the most complex communities, and a better recovery of viruses and plasmids. MetaMDBG performs particularly well for abundant organisms whilst being robust to the presence of strain diversity. The result is that for the first time it is possible to efficiently reconstruct the majority of complex communities by abundance as near-complete MAGs.
Optimization of the In-Silico Mate-Pair Method Improved Contiguity and Accuracy of Genome Assembly

Tao Zhou,Liang Lu,Chenhong Li

DOI: https://doi.org/10.1002/ece3.9745

IF: 3.167

2023-01-01

Ecology and Evolution

Abstract:A combination of short-insert paired-ended and mate-pair libraries of large insert sizes is used as a standard method to generate genome assemblies with high contiguity. The third-generation sequencing techniques also are used to improve the quality of assembled genomes. However, both mate-pair libraries and the third-generation libraries require high-molecular-weight DNA, making the use of these libraries inappropriate for samples with only degraded DNA. An in silico method that generates mate-pair libraries using a reference genome was devised for the task of assembling target genomes. Although the contiguity and completeness of assembled genomes were significantly improved by this method, a high level of errors manifested in the assembly, further to which the methods for using reference genomes, was not optimized. Here, we tested different strategies for using reference genomes to generate in silico mate-pairs. The results showed that using a closely related reference genome from the same genus was more effective than using divergent references. Conservation of in silico mate-pairs by comparing two references and using those to guide genome assembly reduced the number of misassemblies (18.6%-46.1%) and increased the contiguity of assembled genomes (9.7%-70.7%), while maintaining gene completeness at a level that was either similar or marginally lower than that obtained via the current method. Finally, we developed a pipeline of the optimized in silico method and compared it with another reference-guided assembler, RagTag. We found that RagTag produced longer scaffolds (17.8 Mbp vs 3.0 Mbp), but resulted in a much higher misassembly rate (85.68%) than our optimized in silico mate-pair method. This optimized in silico pipeline developed in this study should facilitate further studies on genomics, population genetics, and conservation of endangered species.
Versatile genome assembly evaluation with QUAST-LG

Alla Mikheenko,Andrey Prjibelski,Vladislav Saveliev,Dmitry Antipov,Alexey Gurevich

DOI: https://doi.org/10.1093/bioinformatics/bty266

IF: 5.8

2018-06-27

Bioinformatics

Abstract:Motivation: The emergence of high-throughput sequencing technologies revolutionized genomics in early 2000s. The next revolution came with the era of long-read sequencing. These technological advances along with novel computational approaches became the next step towards the automatic pipelines capable to assemble nearly complete mammalian-size genomes.Results: In this manuscript, we demonstrate performance of the state-of-the-art genome assembly software on six eukaryotic datasets sequenced using different technologies. To evaluate the results, we developed QUAST-LG-a tool that compares large genomic de novo assemblies against reference sequences and computes relevant quality metrics. Since genomes generally cannot be reconstructed completely due to complex repeat patterns and low coverage regions, we introduce a concept of upper bound assembly for a given genome and set of reads, and compute theoretical limits on assembly correctness and completeness. Using QUAST-LG, we show how close the assemblies are to the theoretical optimum, and how far this optimum is from the finished reference.Availability and implementation: http://cab.spbu.ru/software/quast-lg.Supplementary information: Supplementary data are available at Bioinformatics online.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Haplotype assembly from aligned weighted SNP fragments.

Yu-Ying Zhao,Ling-Yun Wu,Ji-Hong Zhang,Rui-Sheng Wang,Xiang-Sun Zhang

DOI: https://doi.org/10.1016/j.compbiolchem.2005.05.001

IF: 3.737

2005-01-01

Computational Biology and Chemistry

Abstract:Given an assembled genome of a diploid organism the haplotype assembly problem can be formulated as retrieval of a pair of haplotypes from a set of aligned weighted SNP fragments. Known computational formulations (models) of this problem are minimum letter flips (MLF) and the weighted minimum letter flips (WMLF; Greenberg et al. (INFORMS J. Comput. 2004, 14, 211-213)). In this paper we show that the general WMLF model is NP-hard even for the gapless case. However the algorithmic solutions for selected variants of WMFL can exist and we propose a heuristic algorithm based on a dynamic clustering technique. We also introduce a new formulation of the haplotype assembly problem that we call COMPLETE WMLF (CWMLF). This model and algorithms for its implementation take into account a simultaneous presence of multiple kinds of data errors. Extensive computational experiments indicate that the algorithmic implementations of the CWMLF model achieve higher accuracy of haplotype reconstruction than the WMLF-based algorithms, which in turn appear to be more accurate than those based on MLF.
BOAssembler: a Bayesian Optimization Framework to Improve RNA-Seq Assembly Performance

Shunfu Mao,Yihan Jiang,Edwin Basil Mathew,Sreeram Kannan

DOI: https://doi.org/10.48550/arXiv.1902.05235

2019-02-14

Abstract:High throughput sequencing of RNA (RNA-Seq) can provide us with millions of short fragments of RNA transcripts from a sample. How to better recover the original RNA transcripts from those fragments (RNA-Seq assembly) is still a difficult task. For example, RNA-Seq assembly tools typically require hyper-parameter tuning to achieve good performance for particular datasets. This kind of tuning is usually unintuitive and time-consuming. Consequently, users often resort to default parameters, which do not guarantee consistent good performance for various datasets. Here we propose BOAssembler (<a class="link-external link-https" href="https://github.com/olivomao/boassembler" rel="external noopener nofollow">this https URL</a>), a framework that enables end-to-end automatic tuning of RNA-Seq assemblers, based on Bayesian Optimization principles. Experiments show this data-driven approach is effective to improve the overall assembly performance. The approach would be helpful for downstream (e.g. gene, protein, cell) analysis, and more broadly, for future bioinformatics benchmark studies.

Genomics
Optimizing DNA Assembly Based on Statistical Language Modelling

Gang Fang,Shemin Zhang,Yafei Dong

DOI: https://doi.org/10.1093/nar/gkx859

IF: 14.9

2017-01-01

Nucleic Acids Research

Abstract:By successively assembling genetic parts such as BioBrick according to grammatical models, complex genetic constructs composed of dozens of functional blocks can be built. However, usually every category of genetic parts includes a few or many parts. With increasing quantity of genetic parts, the process of assembling more than a few sets of these parts can be expensive, time consuming and error prone. At the last step of assembling it is somewhat difficult to decide which part should be selected. Based on statistical language model, which is a probability distribution P(s) over strings S that attempts to reflect how frequently a string S occurs as a sentence, the most commonly used parts will be selected. Then, a dynamic programming algorithm was designed to figure out the solution of maximum probability. The algorithm optimizes the results of a genetic design based on a grammatical model and finds an optimal solution. In this way, redundant operations can be reduced and the time and cost required for conducting biological experiments can be minimized.
Haplotype Assembly Using Manifold Optimization and Error Correction Mechanism

Mohamad Mahdi Mohades,Sina Majidian,Mohammad Hossein Kahaei

DOI: https://doi.org/10.48550/arXiv.1901.00136

2019-04-14

Abstract:Recent matrix completion based methods have not been able to properly model the Haplotype Assembly Problem (HAP) for noisy observations. To cope with such a case, in this letter we propose a new Minimum Error Correction (MEC) based matrix completion optimization problem over the manifold of rank-one matrices. The convergence of a specific iterative algorithm for solving this problem is proved. Simulation results illustrate that the proposed method not only outperforms some well-known matrix completion based methods, but also presents a more accurate result compared to a most recent MEC based algorithm for haplotype estimation.

Optimization and Control,Signal Processing
A Novel High-Accuracy Genome Assembly Method Utilizing a High-Throughput Workflow

Qingdong Zeng,Wenjin Cao,Liping Xing,Guowei Qin,Jianhui Wu,Michael F. Nagle,Qin Xiong,Jinhui Chen,Liming Yang,Prasad Bajaj,Annapurna Chitikineni,Yan Zhou,Yunxin Yu,Jiang Xu,Xiaojun Nie,Lin Huang,Shengjie Liu,Jan Šafář,Hana Šimková,Weining Song,Baozhu Guo,Shilin Chen,Jaroslav Doležel,Zhaodong Hao,Qiang Cheng,Jianguo Liang,Jiansong Tang,Aizhong Cao,Qiang Wang,Xiangqian Lu,Shouping Yang,Hongxiang Ma,Jiajie Liu,Xiaoting Wang,Hong Zhang,Zhonghua Wang,Wanquan Ji,Changfa Wang,Fengping Yuan,Jisen Shi,Rajeev K. Varshney,Zhensheng Kang,Dejun Han,Haibin Xu

DOI: https://doi.org/10.1101/2020.11.26.400507

2020-01-01

bioRxiv

Abstract:Across domains of biological research using genome sequence data, high-quality reference genome sequences are essential for characterizing genetic variation and understanding the genetic basis of phenotypes. However, the construction of genome assemblies for various species is often hampered by complexities of genome organization, especially repetitive and complex sequences, leading to mis-assembly and missing regions. Here, we describe a high-throughput gold standard genome assembly workflow using a large-scale bacterial artificial chromosome (BAC) library with a refined two-step pooling strategy and the Lamp assembler algorithm. This strategy minimizes the laborious processes of physical map construction and clone-by-clone sequencing, enabling inexpensive sequencing of several thousand BAC clones. By applying this strategy with a minimum tiling path BAC clone library for the short arm of chromosome 2D (2DS) of bread wheat, 98% of BAC sequences, covering 92.7% of the 2DS chromosome, were assembled correctly for this species with a highly complex and repetitive genome. We also identified 48 large mis-assemblies in the reference wheat genome assembly (IWGSC RefSeq v1.0) and corrected these large mis-assemblies in addition to filling 92.2% of the gaps in RefSeq v1.0. Our 2DS assembly represents a new benchmark for the assembly of complex genomes with both high accuracy and efficiency.### Competing Interest StatementThe authors have declared no competing interest.
Partial DNA Assembly: A Rate-Distortion Perspective

Ilan Shomorony,Govinda M. Kamath,Fei Xia,Thomas A. Courtade,David N. Tse

DOI: https://doi.org/10.48550/arXiv.1605.01941

2016-05-06

Abstract:Earlier formulations of the DNA assembly problem were all in the context of perfect assembly; i.e., given a set of reads from a long genome sequence, is it possible to perfectly reconstruct the original sequence? In practice, however, it is very often the case that the read data is not sufficiently rich to permit unambiguous reconstruction of the original sequence. While a natural generalization of the perfect assembly formulation to these cases would be to consider a rate-distortion framework, partial assemblies are usually represented in terms of an assembly graph, making the definition of a distortion measure challenging. In this work, we introduce a distortion function for assembly graphs that can be understood as the logarithm of the number of Eulerian cycles in the assembly graph, each of which correspond to a candidate assembly that could have generated the observed reads. We also introduce an algorithm for the construction of an assembly graph and analyze its performance on real genomes.

Information Theory,Genomics
A hierarchical network heuristic for solving the orientation problem in genome assembly

Karl R. B. Schmitt,Aleksey V. Zimin,Guillaume Marcaçs,James A. Yorke,Michelle Girvan

DOI: https://doi.org/10.48550/arXiv.1307.0541

2013-07-02

Abstract:In the past several years, the problem of genome assembly has received considerable attention from both biologists and computer scientists. An important component of current assembly methods is the scaffolding process. This process involves building ordered and oriented linear collections of contigs (continuous overlapping sequence reads) called scaffolds and relies on the use of mate pair data. A mate pair is a set of two reads that are sequenced from the ends of a single fragment of DNA, and therefore have opposite mutual orientations. When two reads of a mate-pair are placed into two different contigs, one can infer the mutual orientation of these contigs. While several orientation algorithms exist as part of assembly programs, all encounter challenges while solving the orientation problem due to errors from mis-assemblies in contigs or errors in read placements. In this paper we present an algorithm based on hierarchical clustering that independently solves the orientation problem and is robust to errors. We show that our algorithm can correctly solve the orientation problem for both faux (generated) assembly data and real assembly data for {\em R. sphaeroides bacteria}. We demonstrate that our algorithm is stable to both changes in the initial orientations as well as noise in the data, making it advantageous compared to traditional approaches.

Genomics
A Genetic Regulatory Network-Based Sequencing Method for Mixed-Model Assembly Lines

Y. Lv,J. Zhang,W. Qin

DOI: https://doi.org/10.14743/apem2017.1.240

2017-01-01

Advances in Production Engineering & Management

Abstract:Mixed-model sequencing to minimize work overload at stations is regarded as one of the most concerned optimization problems in assembly lines manufacturing a variety of product models simultaneously. A novel sequencing method based on the genetic regulatory network is proposed to solve this problem. First, genes, gene regulation equations and gene expression procedures are developed in the network based on its similarity with the mixed-model sequencing problem. Each two-state gene represents a binary decision variable of the mathematical model. The gene regulation equations describe decision variable interactions in the constraints and objectives. The gene expression procedure depends on the regulation equations to generate solutions, in which the value of each decision variable is indicated by the expression state of the related gene. Second, regulatory parameter optimization in the regulation equations minimizes the work overload at stations. The effectiveness of the proposed method is validated through experiments consisting of reference instances and industrial instances. The experimental results demonstrate that this method outperforms other methods in large-scale instances. (C) 2017 PEI, University of Maribor. All rights reserved.
BAUM: A DNA Assembler by Adaptive Unique Mapping and Local Overlap-Layout-Consensus

Anqi Wang,Zheng Li,Zhanyu Wang,Lei M. Li

DOI: https://doi.org/10.48550/arXiv.1609.03073

2016-09-11

Abstract:Genome assembly from the high-throughput sequencing (HTS) reads is a fundamental yet challenging computational problem. An intrinsic challenge is the uncertainty caused by the widespread repetitive elements. Here we get around the uncertainty using the notion of uniquely mapped (UM) reads, which motivated the design of a new assembler BAUM. It mainly consists of two types of iterations. The first type of iterations constructs initial contigs from a reference, say a genome of a species that could be quite distant, by adaptive read mapping, filtration by the reference's unique regions, and reference updating. A statistical test is proposed to split the layouts at possible structural variation sites. The second type of iterations includes mapping, scaffolding/contig-extension, and contig merging. We extend each contig by locally assembling the reads whose mates are uniquely mapped to an end of the contig. Instead of the de Bruijn graph method, we take the overlap-layout-consensus (OLC) paradigm. The OLC is implemented by parallel computation, and has linear complexity with respect to the number of contigs. The adjacent extended contigs are merged if their alignment is confirmed by the adjusted gap distance. Throughout the assembling, the mapping criterion is selected by probabilistic calculations. These innovations can be used complementary to the existing de novo assemblers. Applying this novel method to the assembly of wild rice Oryza longistaminata genome, we achieved much improved contig N50, 18.8k, compared with other assemblers. The assembly was further validated by contigs constructed from an independent library of long 454 reads.

Genomics
Accelerating whole-genome alignment in the age of complete genome assemblies

Ghanshyam Chandra,Md. Vasimuddin,Sanchit Misra,Chirag Jain

DOI: https://doi.org/10.1101/2024.11.25.625328

2024-11-28

Abstract:Recent advancements in long-read sequencing and assembly methods have ushered in an era of high-quality genome assemblies. Modern assemblies commonly feature megabase-long sequences frequently spanning entire chromosomes. The increase in the assembly contiguity and the reduced number of assembly contigs also implies that whole-genome alignment is no longer an embarrassingly parallel problem. The conventional method of aligning sequences of the query genome in parallel is to utilize a single thread per sequence. This results in poor CPU utilization and long runtimes. In this work, we designed optimizations to accelerate whole-genome alignment on multi-core processors and implemented them in a commonly used aligner, minimap2. Our improvements include a fine-grained parallel chaining method and a fast mechanism for differentiating primary and secondary chains. Our approach accelerates alignment of human, plant, and primate genomes by 1.6x to 7.2x without compromising accuracy.

Bioinformatics
Memory Efficient De Bruijn Graph Construction

Yang Li,Pegah Kamousi,Fangqiu Han,Shengqi Yang,Xifeng Yan,Subhash Suri

DOI: https://doi.org/10.48550/arXiv.1207.3532

2012-07-15

Data Structures and Algorithms

Abstract:Massively parallel DNA sequencing technologies are revolutionizing genomics research. Billions of short reads generated at low costs can be assembled for reconstructing the whole genomes. Unfortunately, the large memory footprint of the existing de novo assembly algorithms makes it challenging to get the assembly done for higher eukaryotes like mammals. In this work, we investigate the memory issue of constructing de Bruijn graph, a core task in leading assembly algorithms, which often consumes several hundreds of gigabytes memory for large genomes. We propose a disk-based partition method, called Minimum Substring Partitioning (MSP), to complete the task using less than 10 gigabytes memory, without runtime slowdown. MSP breaks the short reads into multiple small disjoint partitions so that each partition can be loaded into memory, processed individually and later merged with others to form a de Bruijn graph. By leveraging the overlaps among the k-mers (substring of length k), MSP achieves astonishing compression ratio: The total size of partitions is reduced from $\Theta(kn)$ to $\Theta(n)$, where $n$ is the size of the short read database, and $k$ is the length of a $k$-mer. Experimental results show that our method can build de Bruijn graphs using a commodity computer for any large-volume sequence dataset.

Constructing a genome assembly that has the maximum likelihood

Maximum likelihood genome assembly

Minimize Maximum Coverage of Fragment Alignment Selection.

HyDA-Vista: towards optimal guided selection of k-mer size for sequence assembly

Near-optimal Assembly for Shotgun Sequencing with Noisy Reads

Theoretical Bounds on Mate-Pair Information for Accurate Genome Assembly

Bayesian genome assembly and assessment by Markov Chain Monte Carlo sampling

Efficient High-Quality Metagenome Assembly from Long Accurate Reads using Minimizer-space de Bruijn Graphs

Optimization of the In-Silico Mate-Pair Method Improved Contiguity and Accuracy of Genome Assembly

Versatile genome assembly evaluation with QUAST-LG

Haplotype assembly from aligned weighted SNP fragments.

BOAssembler: a Bayesian Optimization Framework to Improve RNA-Seq Assembly Performance

Optimizing DNA Assembly Based on Statistical Language Modelling

Haplotype Assembly Using Manifold Optimization and Error Correction Mechanism

A Novel High-Accuracy Genome Assembly Method Utilizing a High-Throughput Workflow

Partial DNA Assembly: A Rate-Distortion Perspective

A hierarchical network heuristic for solving the orientation problem in genome assembly

A Genetic Regulatory Network-Based Sequencing Method for Mixed-Model Assembly Lines

BAUM: A DNA Assembler by Adaptive Unique Mapping and Local Overlap-Layout-Consensus

Accelerating whole-genome alignment in the age of complete genome assemblies

Memory Efficient De Bruijn Graph Construction