Abstract:Advanced sequencing machines dramatically speed up the generation of genomic data, which makes the demand of efficient compression of sequencing data extremely urgent and significant. As the most difficult part of the standard sequencing data format FASTQ, compression of the quality score has become a conundrum in the development of FASTQ compression. Existing lossless compressors of quality scores mainly utilize specific patterns generated by specific sequencer and complex context modeling techniques to solve the problem of low compression ratio. However, the main drawbacks of these compressors are the problem of weak robustness which means unstable or even unavailable results of sequencing files and the problem of slow compression speed. Meanwhile, some compressors attempt to construct a fine-grained index structure to solve the problem of slow random access decompression speed. However, they solve the problem at the sacrifice of compression speed and at the expense of large index files, which makes them inefficient and impractical. Therefore, an efficient lossless compressor of quality scores with strong robustness, high compression ratio, fast compression and random access decompression speed is urgently needed and of great significance. In this paper, based on the idea of maximizing the use of hardware resources, LCQS, a lossless compression tool specialized for quality scores, was proposed. It consists of four sequential processing steps: partitioning, indexing, packing and parallelizing. Experimental results reveal that LCQS outperforms all the other state-of-the-art compressors on all criteria except for the compression speed on the dataset SRR1284073. Furthermore, LCQS presents strong robustness on all the test datasets, with its acceleration ratios of compression speed increasing by up to 29.1x, its file size reducing by up to 28.78%, and its random access decompression speed increasing by up to 2.1x. Additionally, LCQS also exhibits strong scalability. That is, the compression speed increases almost linearly as the size of input dataset increases. The ability to handle all different kinds of quality scores and superiority in compression ratio and compression speed make LCQS a high-efficient and advanced lossless quality score compressor, along with its strength of fast random access decompression. Our tool LCQS can be downloaded from https://github.com/SCUT-CCNL/LCQSand freely available for non-commercial usage.

RabbitQCPlus: More Efficient Quality Control for Sequencing Data.

RabbitQCPlus 2.0: More efficient and versatile quality control for sequencing data

RabbitQC: high-speed scalable quality control for sequencing data

RabbitFX: Efficient Framework for FASTA/Q File Parsing on Modern Multi-Core Platforms.

RabbitTrim: Highly Optimized Trimming of Illumina Sequencing Data on Multi-core Platforms

RabbitV: Fast Detection of Viruses and Microorganisms in Sequencing Data on Multi-Core Architectures

RabbitKSSD: Accelerating Genome Distance Estimation on Modern Multi-Core Architectures.

RabbitSAlign: Accelerating Short-Read Alignment for CPU-GPU Heterogeneous Platforms

RabbitVar: Ultra-Fast and Accurate Somatic Small-Variant Calling on Multi-Core Architectures

FastqZip: An Improved Reference-Based Genome Sequence Lossy Compression Framework

LCQS: an Efficient Lossless Compression Tool of Quality Scores with Random Access Functionality

Falco: high-speed FastQC emulation for quality control of sequencing data.

RabbitMash: Accelerating Hash-Based Genome Analysis on Modern Multi-Core Architectures.

LFastqC: A lossless non-reference-based FASTQ compressor

PQSDC: a parallel lossless compressor for quality scores data via sequences partition and run-length prediction mapping

SeqKit: A Cross-Platform and Ultrafast Toolkit for FASTA/Q File Manipulation

RNA-SeQC: RNA-seq metrics for quality control and process optimization

CURC: a CUDA-based reference-free read compressor

RNA-QC-chain: Comprehensive and Fast Quality Control for RNA-Seq Data

ClinQC: a tool for quality control and cleaning of Sanger and NGS data in clinical research

RabbitTClust: Enabling Fast Clustering Analysis of Millions of Bacteria Genomes with MinHash Sketches.