Abstract:Background: Processing raw genomic data for downstream applications such as imputation, association studies, and modeling requires numerous third-party bioinformatics software tools. It is highly time-consuming and resource-intensive with computational demands and storage limitations that pose significant challenges that increase cost. The use of software tools independent of one another, in a disjointed stepwise fashion, increases the difficulty and sets forth higher error rates because of fragmented job executions in alignment, variant calling, and/or build conversion complications. As sequencing data availability grows, the ability for biologists to process it using stable, automated, and reproducible workflows is paramount as it significantly reduces the time to generate clean and reliable data. Results: The Iliad suite of genomic data workflows was developed to provide users with seamless file transitions from raw genomic data to a quality-controlled variant call format (VCF) file for downstream applications. Iliad benefits from the efficiency of the Snakemake best practices framework coupled with Singularity and Docker containers for repeatability, portability, and ease of installation. This feat is accomplished from the onset with download acquisitions of any raw data type (FASTQ, CRAM, IDAT) straight through to the generation of a clean merged data file that can combine any user-preferred datasets using robust programs such as BWA, Samtools, and BCFtools. Users can customize and direct their workflow with one straightforward configuration file. Iliad is compatible with Linux, MacOS, and Windows platforms and scalable from a local machine to a high-performance computing cluster. Conclusion: Iliad offers automated workflows with optimized time and resource management that are comparable to other workflows available but generates analysis-ready VCF files from the most common datatypes using a single command. The storage footprint challenge of genomic data is overcome by utilizing temporary intermediate files before the final VCF is generated. This file is ready for use in imputation, genome-wide association study (GWAS) pipelines, high-throughput population genetics studies, select gene candidate studies, and more. Iliad was developed to be portable, compatible, scalable, robust, and repeatable with a simplistic setup, so biologists that are less familiar with programming can manage their own big data with this open-source suite of workflows.

CIEVaD: a lightweight workflow collection for rapid and on demand deployment of end-to-end testing of genomic variant detection

CIEVaD: A Lightweight Workflow Collection for the Rapid and On-Demand Deployment of End-to-End Testing for Genomic Variant Detection

OVarFlow: a resource optimized GATK 4 based Open source Variant calling workFlow

Scalable and efficient DNA sequencing analysis on different compute infrastructures aiding variant discovery

Kuura—An automated workflow for analyzing WES and WGS data

eQTL-Detect: nextflow-based pipeline for eQTL detection in modular format with sharable and parallelizable scripts

DNAscan: a fast, computationally and memory efficient bioinformatics pipeline for the analysis of DNA next-generation-sequencing data

Custom Biomedical FAIR Data Analysis in the Cloud Using CAVATICA

A high-performance computational workflow to accelerate GATK SNP detection across a 25-genome dataset

VariantDetective: an accurate all-in-one pipeline for detecting consensus bacterial SNPs and SVs

VAREANT: a bioinformatics application for gene variant reduction and annotation

NFTest: automated testing of Nextflow pipelines

Genomevip: A Cloud Platform For Genomic Variant Discovery And Interpretation

ILIAD: a suite of automated Snakemake workflows for processing genomic data for downstream applications

FAIR privacy-preserving operation of large genomic variant calling format (VCF) data without download or installation

Structural variation and fusion detection using targeted sequencing data from circulating cell free DNA

Variant calling pipelines for whole exome sequencing in clinical context

CLEVER: Clique-Enumerating Variant Finder

CNVizard: a lightweight streamlit application for an interactive analysis of copy number variants

VariFAST: a Variant Filter by Automated Scoring Based on Tagged-Signatures

Metapipeline-DNA: A Comprehensive Germline & Somatic Genomics Nextflow Pipeline