Abstract:Recent research on multi-view clustering algorithms for complex disease subtyping often overlooks aspects like clustering stability and critical assessment of prognostic relevance. Furthermore, current frameworks do not allow for a comparison between data-driven and pathway-driven clustering, highlighting a significant gap in the methodology. We present the COPS R-package, tailored for robust evaluation of single and multi-omics clustering results. COPS features advanced methods, including similarity networks, kernel-based approaches, dimensionality reduction, and pathway knowledge integration. Some of these methods are not accessible through R, and some correspond to new approaches proposed with COPS. Our framework was rigorously applied to multi-omics data across seven cancer types, including breast, prostate, and lung, utilizing mRNA, CNV, miRNA, and DNA methylation data. Unlike previous studies, our approach contrasts data- and knowledge-driven multi-view clustering methods and incorporates cross-fold validation for robustness. Clustering outcomes were assessed using the ARI score, survival analysis via Cox regression models including relevant covariates, and the stability of the results. While survival analysis and gold-standard agreement are standard metrics, they vary considerably across methods and datasets. Therefore, it is essential to assess multi-view clustering methods using multiple criteria, from cluster stability to prognostic relevance, and to provide ways of comparing these metrics simultaneously to select the optimal approach for disease subtype discovery in novel datasets. Emphasizing multi-objective evaluation, we applied the Pareto efficiency concept to gauge the equilibrium of evaluation metrics in each cancer case-study. Affinity Network Fusion, Integrative Non-negative Matrix Factorization, and Multiple Kernel K-Means with linear or Pathway Induced Kernels were the most stable and effective in discerning groups with significantly different survival outcomes in several case studies.

Integrity and miss grouping as support for clusters in agglomerative hierarchical methods: the R-package octopucs

Defining Loci in Restriction-Based Reduced Representation Genomic Data from Nonmodel Species: Sources of Bias and Diagnostics for Optimal Clustering

Improved Hierarchical Clustering on Massive Datasets with Broad Guarantees

Clustering populations by mixed linear models

Data Structures & Algorithms for Exact Inference in Hierarchical Clustering

Order preserving hierarchical agglomerative clustering

Defining clusters from a hierarchical cluster tree: the Dynamic Tree Cut package for R

Hierarchical Clustering Supported by Reciprocal Nearest Neighbors

Iterative Optimization and Simplification of Hierarchical Clusterings

Cluster Merging and Splitting in Hierarchical Clustering Algorithms

Clustering 16S Rrna for OTU Prediction: a Method of Unsupervised Bayesian Clustering.

An Ensemble Hierarchical Clustering Algorithm Based on Merits at Cluster and Partition Levels

COPS: A novel platform for multi-omic disease subtype discovery via robust multi-objective evaluation of clustering algorithms

Fair Algorithms for Hierarchical Agglomerative Clustering

When Does Bottom-up Beat Top-down in Hierarchical Community Detection?

The R Package HCV for Hierarchical Clustering from Vertex-links

Robust Hierarchical Clustering for Directed Networks: An Axiomatic Approach

Hierarchical Ordination, A unifying framework for drivers of community processes

Parsimonious consensus hierarchies, partitions and fuzzy partitioning of a set of hierarchies

Clusters that are not there: An R tutorial and a Shiny app to quantify a priori inferential risks when using clustering methods

mdendro: An R package for extended agglomerative hierarchical clustering