Abstract:Background and objective Short-read sequencing is becoming the standard of practice for the study of structural variants associated with disease. However, with the growth of sequence data largely surpassing reasonable storage capability, the biomedical community is challenged with the management, transfer, archiving, and storage of sequence data.Methods We developed Hierarchical mUlti-reference Genome cOmpression (HUGO), a novel compression algorithm for aligned reads in the sorted Sequence Alignment/Map (SAM) format. We first aligned short reads against a reference genome and stored exactly mapped reads for compression. For the inexact mapped or unmapped reads, we realigned them against different reference genomes using an adaptive scheme by gradually shortening the read length. Regarding the base quality value, we offer lossy and lossless compression mechanisms. The lossy compression mechanism for the base quality values uses k-means clustering, where a user can adjust the balance between decompression quality and compression rate. The lossless compression can be produced by setting k (the number of clusters) to the number of different quality values.Results The proposed method produced a compression ratio in the range 0.5-0.65, which corresponds to 35-50% storage savings based on experimental datasets. The proposed approach achieved 15% more storage savings over CRAM and comparable compression ratio with Samcomp (CRAM and Samcomp are two of the state-of-the-art genome compression algorithms). The software is freely available at https://sourceforge.net/projects/hierachicaldnac/with a General Public License (GPL) license.Limitation Our method requires having different reference genomes and prolongs the execution time for additional alignments.Conclusions The proposed multi-reference-based compression algorithm for aligned reads outperforms existing single-reference based algorithms.

A Novel Compression Algorithm for High-Throughput DNA Sequence Based on Huffman Coding Method

High efficiency referential genome compression algorithm.

High-speed and High-Ratio Referential Genome Compression

An Adaptive Difference Distribution-Based Coding with Hierarchical Tree Structure for DNA Sequence Compression

Genome Compression Against a Reference

Modified HuffBit Compress Algorithm – An Application of R

A Novel Lossless Encoding Algorithm for Data Compression - Genomics Data as an Exemplar

Compressing Genomic Sequences by Using Deep Learning

A Novel Compression Tool For Efficient Storage Of Genome Resequencing Data

Handling the data management needs of high-throughput sequencing data: SpeedGene, a compression algorithm for the efficient storage of genetic data

DNACompress: Fast and Effective DNA Sequence Compression

K-means clustering based compression algorithm for the high-throughput DNA sequence

Dna-Compact: Dna Compression Based on A Pattern-Aware Contextual Modeling Technique

FastqZip: An Improved Reference-Based Genome Sequence Lossy Compression Framework

HUGO: Hierarchical Multi-Reference Genome Compression for Aligned Reads.

Research and Implementation of Dictionary-based DNA Compression Algorithm

Genetic Sequence compression using Machine Learning and Arithmetic Encoding Decoding Techniques

Human Mitochondrial Genome Compression Using Machine Learning Techniques

Compression of high throughput sequencing data with probabilistic de Bruijn graph

Genbit Compress Tool(GBC): A Java-Based Tool to Compress DNA Sequences and Compute Compression Ratio(bits/base) of Genomes

Direct-Coding DNA With Multilevel Parallelism