Abstract:Harnessing the power of microbial consortia is integral to a diverse range of sectors, from healthcare to biotechnology to environmental remediation. To fully realize this potential, it is critical to understand the mechanisms behind the interactions that structure microbial consortia and determine their functions. Constraint-based reconstruction and analysis (COBRA) approaches, employing genome-scale metabolic models (GEMs), have emerged as the state-of-the-art tool to simulate the behavior of microbial communities from their constituent genomes. In the last decade, many tools have been developed that use COBRA approaches to simulate multi-species consortia, under either steady-state, dynamic, or spatiotemporally varying scenarios. Yet, these tools have not been systematically evaluated regarding their software quality, most suitable application, and predictive power. Hence, it is uncertain which tools users should apply to their system and what are the most urgent directions that developers should take in the future to improve existing capacities. This study conducted a systematic evaluation of COBRA-based tools for microbial communities using datasets from two-member communities as test cases. First, we performed a qualitative assessment in which we evaluated 24 published tools based on a list of FAIR (Findability, Accessibility, Interoperability, and Reusability) features essential for software quality. Next, we quantitatively tested the predictions in a subset of 14 of these tools against experimental data from three different case studies: a) syngas fermentation by C. autoethanogenum and C. kluyveri for the static tools, b) glucose/xylose fermentation with engineered E. coli and S. cerevisiae for the dynamic tools, and c) a Petri dish of E. coli and S. enterica for tools incorporating spatiotemporal variation. Our results show varying performance levels of the best qualitatively assessed tools when examining the different categories of tools. The differences in the mathematical formulation of the approaches and their relation to the results were also discussed. Ultimately, we provide recommendations for refining future GEM microbial modeling tools.

DEMETER: Efficient simultaneous curation of genome-scale reconstructions guided by experimental data and refined gene annotations

TRITEX: Chromosome-Scale Sequence Assembly of Triticeae Genomes with Open-Source Tools

A structured evaluation of genome-scale constraint-based modeling tools for microbial consortia

MetaCerberus: distributed highly parallelized HMM-based processing for robust functional annotation across the tree of life

Gencube: Efficient retrieval, download, and unification of genomic data from leading biodiversity databases

Medusa: software to build and analyze ensembles of genome-scale metabolic network reconstructions

Orca: A Cobra Toolbox Extension for Model-Driven Discovery and Analysis

Creation and analysis of biochemical constraint-based models: the COBRA Toolbox v3.0

CoBRA: Containerized Bioinformatics Workflow for Reproducible ChIP/ATAC-seq Analysis

Disentangling Cobionts and Contamination in Long-Read Genomic Data using Sequence Composition

RAVEN 2.0: A versatile toolbox for metabolic network reconstruction and a case study on Streptomyces coelicolor

Integrating gene annotation with orthology inference at scale

TEtrimmer: a novel tool to automate the manual curation of transposable elements

MarkerScan: Separation and assembly of cobionts sequenced alongside target species in biodiversity genomics projects

KOBAS-i: intelligent prioritization and exploratory visualization of biological functions for gene enrichment analysis

GEOMetaCuration: a Web-Based Application for Accurate Manual Curation of Gene Expression Omnibus Metadata

MOSGA: Modular Open-Source Genome Annotator

COVRECON: automated integration of genome- and metabolome-scale network reconstruction and data-driven inverse modeling of metabolic interaction networks

tombRaider - improved species and haplotype recovery from metabarcoding data through artefact and pseudogene exclusion.

Navigating Eukaryotic Genome Annotation Pipelines: A Route Map to BRAKER, Galba, and TSEBRA