Cluster analysis basics and extensions. R package version 1.12. 1

M Maechler, P Rousseeuw, A Struyf, M Hubert, K Hornik

2005-01-01

Abstract:

What problem does this paper attempt to address?

Model-Based Clustering, Discriminant Analysis, and Density Estimation

Chris Fraley,Adrian E Raftery

DOI: https://doi.org/10.1198/016214502760047131

IF: 4.369

2002-06-01

Journal of the American Statistical Association

Abstract:Cluster analysis is the automated search for groups of related observations in a dataset. Most clustering done in practice is based largely on heuristic but intuitively reasonable procedures, and most clustering methods available in commercial software are also of this type. However, there is little systematic guidance associated with these methods for solving important practical questions that arise in cluster analysis, such as how many clusters are there, which clustering method should be used, and how should outliers be handled. We review a general methodology for model-based clustering that provides a principled statistical approach to these issues. We also show that this can be useful for other problems in multivariate analysis, such as discriminant analysis and multivariate density estimation. We give examples from medical diagnosis, minefield detection, cluster recovery from noisy data, and spatial density estimation. Finally, we mention limitations of the methodology and discuss recent developments in model-based clustering for non-Gaussian data, high-dimensional datasets, large datasets, and Bayesian estimation.

statistics & probability
Hierarchical Cluster Analysis In Clinical Research With Heterogeneous Study Population: Highlighting Its Visualization With R

Zhongheng Zhang,Fionn Murtagh,Sven Van Poucke,Su Lin,Peng Lan

DOI: https://doi.org/10.21037/atm.2017.02.05

IF: 3.616

2017-01-01

Annals of Translational Medicine

Abstract:Big data clinical research typically involves thousands of patients and there are numerous variables available. Conventionally, these variables can be handled by multivariable regression modeling. In this article, the hierarchical cluster analysis (HCA) is introduced. This method is used to explore similarity between observations and/or clusters. The result can be visualized using heat maps and dendrograms. Sometimes, it would be interesting to add scatter plot and smooth lines into the panels of the heat map. The inherent R heatmap package does not provide this function. A series of scatter plots can be created using lattice package, and then background color of each panel is mapped to the regression coefficient by using custom-made panel functions. This is the unique feature of the lattice package. Dendrograms and color keys can be added as the legend elements of the lattice system. The latticeExtra package provides some useful functions for the work.
Leverage, Influence, and the Jackknife in Clustered Regression Models: Reliable Inference Using summclust

James G. MacKinnon,Morten Ørregaard Nielsen,Matthew D. Webb

DOI: https://doi.org/10.48550/arXiv.2205.03288

2023-11-23

Abstract:We introduce a new Stata package called summclust that summarizes the cluster structure of the dataset for linear regression models with clustered disturbances. The key unit of observation for such a model is the cluster. We therefore propose cluster-level measures of leverage, partial leverage, and influence and show how to compute them quickly in most cases. The measures of leverage and partial leverage can be used as diagnostic tools to identify datasets and regression designs in which cluster-robust inference is likely to be challenging. The measures of influence can provide valuable information about how the results depend on the data in the various clusters. We also show how to calculate two jackknife variance matrix estimators efficiently as a byproduct of our other computations. These estimators, which are already available in Stata, are generally more conservative than conventional variance matrix estimators. The summclust package computes all the quantities that we discuss.

Econometrics
clusterMaker2: a major update to clusterMaker, a multi-algorithm clustering app for Cytoscape

Maija Utriainen,John H Morris

DOI: https://doi.org/10.1186/s12859-023-05225-z

IF: 3.307

2023-04-05

BMC Bioinformatics

Abstract:Background: Since the initial publication of clusterMaker, the need for tools to analyze large biological datasets has only increased. New datasets are significantly larger than a decade ago, and new experimental techniques such as single-cell transcriptomics continue to drive the need for clustering or classification techniques to focus on portions of datasets of interest. While many libraries and packages exist that implement various algorithms, there remains the need for clustering packages that are easy to use, integrated with visualization of the results, and integrated with other commonly used tools for biological data analysis. clusterMaker2 has added several new algorithms, including two entirely new categories of analyses: node ranking and dimensionality reduction. Furthermore, many of the new algorithms have been implemented using the Cytoscape jobs API, which provides a mechanism for executing remote jobs from within Cytoscape. Together, these advances facilitate meaningful analyses of modern biological datasets despite their ever-increasing size and complexity. Results: The use of clusterMaker2 is exemplified by reanalyzing the yeast heat shock expression experiment that was included in our original paper; however, here we explored this dataset in significantly more detail. Combining this dataset with the yeast protein-protein interaction network from STRING, we were able to perform a variety of analyses and visualizations from within clusterMaker2, including Leiden clustering to break the entire network into smaller clusters, hierarchical clustering to look at the overall expression dataset, dimensionality reduction using UMAP to find correlations between our hierarchical visualization and the UMAP plot, fuzzy clustering, and cluster ranking. Using these techniques, we were able to explore the highest-ranking cluster and determine that it represents a strong contender for proteins working together in response to heat shock. We found a series of clusters that, when re-explored as fuzzy clusters, provide a better presentation of mitochondrial processes. Conclusions: clusterMaker2 represents a significant advance over the previously published version, and most importantly, provides an easy-to-use tool to perform clustering and to visualize clusters within the Cytoscape network context. The new algorithms should be welcome to the large population of Cytoscape users, particularly the new dimensionality reduction and fuzzy clustering techniques.
latrend: A Framework for Clustering Longitudinal Data

Niek Den Teuling,Steffen Pauws,Edwin van den Heuvel

2024-02-22

Abstract:Clustering of longitudinal data is used to explore common trends among subjects over time for a numeric measurement of interest. Various R packages have been introduced throughout the years for identifying clusters of longitudinal patterns, summarizing the variability in trajectories between subject in terms of one or more trends. We introduce the R package "latrend" as a framework for the unified application of methods for longitudinal clustering, enabling comparisons between methods with minimal coding. The package also serves as an interface to commonly used packages for clustering longitudinal data, including "dtwclust", "flexmix", "kml", "lcmm", "mclust", "mixAK", and "mixtools". This enables researchers to easily compare different approaches, implementations, and method specifications. Furthermore, researchers can build upon the standard tools provided by the framework to quickly implement new cluster methods, enabling rapid prototyping. We demonstrate the functionality and application of the latrend package on a synthetic dataset based on the therapy adherence patterns of patients with sleep apnea.

Machine Learning
Clusters that are not there: An R tutorial and a Shiny app to quantify a priori inferential risks when using clustering methods

Enrico Toffalini,Filippo Gambarota,Ambra Perugini,Paolo Girardi,Valentina Tobia,Gianmarco Altoè,David Giofrè,Psicostat Core Team,Tommaso Feraco

DOI: https://doi.org/10.1002/ijop.13246

2024-09-21

International Journal of Psychology

Abstract:Clustering methods are increasingly used in social science research. Generally, researchers use them to infer the existence of qualitatively different types of individuals within a larger population, thus unveiling previously "hidden" heterogeneity. Depending on the clustering technique, however, valid inference requires some conditions and assumptions. Common risks include not only failing to detect existing clusters due to a lack of power but also revealing clusters that do not exist in the population. Simple data simulations suggest that under conditions of sample size, number, correlation and skewness of indicators that are frequently encountered in applied psychological research, commonly used clustering methods are at a high risk of detecting clusters that are not there. Generally, this is due to some violations of assumptions that are not usually considered critical in psychology. The present article illustrates a simple R tutorial and a Shiny app (for those who are not familiar with R) that allow researchers to quantify a priori inferential risks when performing clustering methods on their own data. Doing so is suggested as a much‐needed preliminary sanity check, because conditions that inflate the number of detected clusters are very common in applied psychological research scenarios.

psychology, multidisciplinary
Cluster analysis: A modern statistical review

Adam Jaeger,David Banks

DOI: https://doi.org/10.1002/wics.1597

2022-08-29

Wiley Interdisciplinary Reviews: Computational Statistics

Abstract:Dendrograms made using different dissimilarity metrics in the cluster analyses Cluster analysis is a big, sprawling field. This review paper cannot hope to fully survey the territory. Instead, it focuses on hierarchical agglomerative clustering, k‐means clustering, mixture models, and then several related topics of which any cluster analysis practitioner should be aware. Even then, this review cannot do justice to the chosen topics. There is a lot of literature, and often it is somewhat ad hoc. That is generally the nature of cluster analysis—each application requires a bespoke analysis. Nonetheless, clustering has proven itself to be incredibly useful as an exploratory data analysis tool in biology, advertising, recommender systems, and genomics. This article is categorized under: Statistical Learning and Exploratory Methods of the Data Sciences > Clustering and Classification
clusterMaker: a multi-algorithm clustering plugin for Cytoscape

John H Morris,Leonard Apeltsin,Aaron M Newman,Jan Baumbach,Tobias Wittkop,Gang Su,Gary D Bader,Thomas E Ferrin

DOI: https://doi.org/10.1186/1471-2105-12-436

IF: 3.307

2011-11-09

BMC Bioinformatics

Abstract:Background: In the post-genomic era, the rapid increase in high-throughput data calls for computational tools capable of integrating data of diverse types and facilitating recognition of biologically meaningful patterns within them. For example, protein-protein interaction data sets have been clustered to identify stable complexes, but scientists lack easily accessible tools to facilitate combined analyses of multiple data sets from different types of experiments. Here we present clusterMaker, a Cytoscape plugin that implements several clustering algorithms and provides network, dendrogram, and heat map views of the results. The Cytoscape network is linked to all of the other views, so that a selection in one is immediately reflected in the others. clusterMaker is the first Cytoscape plugin to implement such a wide variety of clustering algorithms and visualizations, including the only implementations of hierarchical clustering, dendrogram plus heat map visualization (tree view), k-means, k-medoid, SCPS, AutoSOME, and native (Java) MCL. Results: Results are presented in the form of three scenarios of use: analysis of protein expression data using a recently published mouse interactome and a mouse microarray data set of nearly one hundred diverse cell/tissue types; the identification of protein complexes in the yeast Saccharomyces cerevisiae; and the cluster analysis of the vicinal oxygen chelate (VOC) enzyme superfamily. For scenario one, we explore functionally enriched mouse interactomes specific to particular cellular phenotypes and apply fuzzy clustering. For scenario two, we explore the prefoldin complex in detail using both physical and genetic interaction clusters. For scenario three, we explore the possible annotation of a protein as a methylmalonyl-CoA epimerase within the VOC superfamily. Cytoscape session files for all three scenarios are provided in the Additional Files section. Conclusions: The Cytoscape plugin clusterMaker provides a number of clustering algorithms and visualizations that can be used independently or in combination for analysis and visualization of biological data sets, and for confirming or generating hypotheses about biological function. Several of these visualizations and algorithms are only available to Cytoscape users through the clusterMaker plugin. clusterMaker is available via the Cytoscape plugin manager.
Wilcoxon Rank-Based Tests for Clustered Data with R Package clusrank

Yujing Jiang,Xin He,Mei-Ling Ting Lee,Bernard Rosner,Jun Yan

DOI: https://doi.org/10.48550/arXiv.1706.03409

2017-06-12

Abstract:Wilcoxon Rank-based tests are distribution-free alternatives to the popular two-sample and paired t-tests. For independent data, they are available in several R packages such as stats and coin. For clustered data, in spite of the recent methodological developments, there did not exist an R package that makes them available at one place. We present a package clusrank where the latest developments are implemented and wrapped under a unified user-friendly interface. With different methods dispatched based on the inputs, this package offers great flexibility in rank-based tests for various clustered data. Exact tests based on permutations are also provided for some methods. Details of the major schools of different methods are briefly reviewed. Usages of the package clusrank are illustrated with simulated data as well as a real dataset from an ophthalmological study. The package also enables convenient comparison between selected methods under settings that have not been studied before and the results are discussed.

Computation
Cluster Analysis of Medical Research Data using R

C. V. G. Rao,M. S. Rao,Lavanya Pamulaparty

2016-04-22

Abstract:Cluster analysis divides the data into groups that are meaningful, useful or both. It is also used as a starting point for other purposes of data summarization. This paper discuss some very basic algorithms like K-means, Fuzzy C-means, Hierarchical clustering to come up with clusters, and use R data mining tool. The results are tested on the datasets namely Online News Popularity, Iris Data Set and from UCI data repository and mi RNA dataset for medical data analysis. All datasets was analyzed with different clustering algorithms and the figures we are showing is the working of them in R data mining tool. Every algorithm has its uniqueness and antithetical behavior.

Medicine,Computer Science
Clustering -- Basic concepts and methods

Jan-Oliver Felix Kapp-Joswig,Bettina G. Keller

DOI: https://doi.org/10.48550/arXiv.2212.01248

IF: 5.414

2022-12-01

Machine Learning

Abstract:We review clustering as an analysis tool and the underlying concepts from an introductory perspective. What is clustering and how can clusterings be realised programmatically? How can data be represented and prepared for a clustering task? And how can clustering results be validated? Connectivity-based versus prototype-based approaches are reflected in the context of several popular methods: single-linkage, spectral embedding, k-means, and Gaussian mixtures are discussed as well as the density-based protocols (H)DBSCAN, Jarvis-Patrick, CommonNN, and density-peaks.
ggClusterNet: An R package for microbiome network analysis and modularity‐based multiple network layouts

Tao Wen,Penghao Xie,Shengdie Yang,Guoqing Niu,Xiaoyu Liu,Zhexu Ding,Chao Xue,Yong‐Xin Liu,Qirong Shen,Jun Yuan

DOI: https://doi.org/10.1002/imt2.32

2022-07-01

iMeta

Abstract:ggClusterNet is an R package for microbial networks analysis and interpretation. Ten network layout algorithms allow users more alternatives to plot the network and generate published‐ready figures. It is free to access on GitHub and Gitee. The network analysis has attracted increasing attention and interest from ecological academics, thus it is of great necessity to develop more convenient and powerful tools. For that reason, we have developed an R package, named "ggClusterNet," to complete and display the network analysis in an easier manner. In that package, ten network layout algorithms are designed to better display the modules of microbiome network (randomClusterG, PolygonClusterG, PolygonRrClusterG, ArtifCluster, randSNEClusterG, PolygonModsquareG, PolyRdmNotdCirG, model_Gephi.2, model_igraph, and model_maptree). For the convenience of the users, many functions related to microbial network analysis, such as corMicor(), net_properties(), node_properties(), ZiPiPlot(), random_Net_compate(), are integrated to complete the network mining. Furthermore, the pipeline function named network.2() and corBionetwork() are also added for the quick achievement of the network or bipartite network analysis as well as their in‐depth mining. The ggClusterNet is publicly available via GitHub (https://github.com/taowenmicro/ggClusterNet/) or Gitee (https://gitee.com/wentaomicro/ggClusterNet) for users' access. A complete description of the usages can be found on the manuscript's GitHub page (https://github.com/taowenmicro/ggClusterNet/wiki).
A toolbox for fuzzy clustering using the R programming language

Maria Brigida Ferraro,Paolo Giordani

DOI: https://doi.org/10.1016/j.fss.2015.05.001

IF: 4.462

2015-11-01

Fuzzy Sets and Systems

Abstract:Fuzzy clustering is used extensively in several domains of research. In the literature, starting from the well-known fuzzy k-means (fkm) clustering algorithm, an increasing number of papers devoted to fkm and its extensions can be found. Nevertheless, a lack of the related software for implementing these algorithms can be observed preventing their use in practice. Even the standard fkm is not necessarily available in the most common software. For this purpose, a new toolbox for fuzzy clustering using the R programming language is presented by examples. The toolbox, called fclust, contains a suit of fuzzy clustering algorithms, fuzzy cluster validity indices and visualization tools for fuzzy clustering results.

mathematics, applied,statistics & probability,computer science, theory & methods
clusterProfiler: an R Package for Comparing Biological Themes Among Gene Clusters

Guangchuang Yu,Li-Gen Wang,Yanyan Han,Qing-Yu He

DOI: https://doi.org/10.1089/omi.2011.0118

2012-05-01

Abstract:Increasing quantitative data generated from transcriptomics and proteomics require integrative strategies for analysis. Here, we present an R package, clusterProfiler that automates the process of biological-term classification and the enrichment analysis of gene clusters. The analysis module and visualization module were combined into a reusable workflow. Currently, clusterProfiler supports three species, including humans, mice, and yeast. Methods provided in this package can be easily extended to other species and ontologies. The clusterProfiler package is released under Artistic-2.0 License within Bioconductor project. The source code and vignette are freely available at http://bioconductor.org/packages/release/bioc/html/clusterProfiler.html.
An Advanced Cluster Analysis Method Based on Statistical Test

XB Gao,HB Ji,L Jie

DOI: https://doi.org/10.1109/icosp.2002.1179981

2002-01-01

Abstract:The paper presents a novel clustering algorithm supervised by statistical tests. It deals simultaneously with three key data analysis problems: cluster tendency; cluster analysis; cluster validity. It provides an effective tool to analyze the validity and reasonableness of unsupervised pattern classification, especially in the case of a large number of samples. The experimental result illustrates its effectiveness.
mdendro: An R package for extended agglomerative hierarchical clustering

Alberto Fernández,Sergio Gómez

2024-08-20

Abstract:"mdendro" is an R package that provides a comprehensive collection of linkage methods for agglomerative hierarchical clustering on a matrix of proximity data (distances or similarities), returning a multifurcated dendrogram or multidendrogram. Multidendrograms can group more than two clusters at the same time, solving the nonuniqueness problem that arises when there are ties in the data. This problem causes that different binary dendrograms are possible depending both on the order of the input data and on the criterion used to break ties. Weighted and unweighted versions of the most common linkage methods are included in the package, which also implements two parametric linkage methods. In addition, package "mdendro" provides five descriptive measures to analyze the resulting dendrograms: cophenetic correlation coefficient, space distortion ratio, agglomeration coefficient, chaining coefficient and tree balance.

Information Retrieval,Data Analysis, Statistics and Probability,Computation
dendextend: an R package for visualizing, adjusting and comparing trees of hierarchical clustering

Tal Galili

DOI: https://doi.org/10.1093/bioinformatics/btv428

IF: 5.8

2015-07-23

Bioinformatics

Abstract:dendextend is an R package for creating and comparing visually appealing tree diagrams. dendextend provides utility functions for manipulating dendrogram objects (their color, shape and content) as well as several advanced methods for comparing trees to one another (both statistically and visually). As such, dendextend offers a flexible framework for enhancing R's rich ecosystem of packages for performing hierarchical clustering of items.AVAILABILITY AND IMPLEMENTATION: The dendextend R package (including detailed introductory vignettes) is available under the GPL-2 Open Source license and is freely available to download from CRAN at: (http://cran.r-project.org/package=dendextend)CONTACT: Tal.Galili@math.tau.ac.il.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
clustifyr: an R package for automated single-cell RNA sequencing cluster classification

Rui Fu,Austin E. Gillen,Ryan M. Sheridan,Chengzhe Tian,Michelle Daya,Yue Hao,Jay R. Hesselberth,Kent A. Riemondy

DOI: https://doi.org/10.12688/f1000research.22969.2

2020-07-16

F1000Research

Abstract:Assignment of cell types from single-cell RNA sequencing (scRNA-seq) data remains a time-consuming and error-prone process. Current packages for identity assignment use limited types of reference data and often have rigid data structure requirements. We developed the clustifyr R package to leverage several external data types, including gene expression profiles to assign likely cell types using data from scRNA-seq, bulk RNA-seq, microarray expression data, or signature gene lists. We benchmark various parameters of a correlation-based approach and implement gene list enrichment methods. clustifyr is a lightweight and effective cell-type assignment tool developed for compatibility with various scRNA-seq analysis workflows. clustifyr is publicly available at https://github.com/rnabioco/clustifyr
Clusterwise Functional Linear Regression Models.

Ting Li,Xinyuan Song,Yingying Zhang,Hongtu Zhu,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.csda.2021.107192

IF: 2.035

2021-01-01

Computational Statistics & Data Analysis

Abstract:Classical clusterwise linear regression is a useful method for investigating the relationship between scalar predictors and scalar responses with heterogeneous variation of regression patterns for different subgroups of subjects. This paper extends the classical clusterwise linear regression to incorporate multiple functional predictors by representing the functional coefficients in terms of a functional principal component basis. We estimate the functional principal component coefficients based on M-estimation and K-means clustering algorithm, which can classify the data into clusters and estimate clusterwise coefficients simultaneously. One advantage of the proposed method is that it is robust and flexible by adopting a general loss function, which can be broadly applied to mean regression, median regression, quantile regression and robust mean regression. A Bayesian information criterion is proposed to select the unknown number of groups and shown to be consistent in model selection. We also obtain the convergence rate of the set of estimators to the set of true coefficients for all clusters. Simulation studies and real data analysis show that the proposed method is easily implemented, and it consequently improves previous works and also requires much less computing burden than existing methods.
rCOSA: A Software Package for Clustering Objects on Subsets of Attributes

Maarten M. Kampert,Jacqueline J. Meulman,Jerome H. Friedman

DOI: https://doi.org/10.48550/arXiv.1612.00259

2016-11-30

Abstract:\texttt{rCOSA} is a software package interfaced to the R language. It implements statistical techniques for clustering objects on subsets of attributes in multivariate data. The main output of COSA is a dissimilarity matrix that one can subsequently analyze with a variety of proximity analysis methods. Our package extends the original COSA software (Friedman and Meulman, 2004) by adding functions for hierarchical clustering methods, least squares multidimensional scaling, partitional clustering, and data visualization. In the many publications that cite the COSA paper by Friedman and Meulman (2004), the COSA program is actually used only a small number of times. This can be attributed to the fact that thse original implementation is not very easy to install and use. Moreover, the available software is out-of-date. Here, we introduce an up-to-date software package and a clear guidance for this advanced technique. The software package and related links are available for free at: \url{<a class="link-external link-https" href="https://github.com/mkampert/rCOSA" rel="external noopener nofollow">this https URL</a>}

Computation

Cluster analysis basics and extensions. R package version 1.12. 1

Model-Based Clustering, Discriminant Analysis, and Density Estimation

Hierarchical Cluster Analysis In Clinical Research With Heterogeneous Study Population: Highlighting Its Visualization With R

Leverage, Influence, and the Jackknife in Clustered Regression Models: Reliable Inference Using summclust

clusterMaker2: a major update to clusterMaker, a multi-algorithm clustering app for Cytoscape

latrend: A Framework for Clustering Longitudinal Data

Clusters that are not there: An R tutorial and a Shiny app to quantify a priori inferential risks when using clustering methods

Cluster analysis: A modern statistical review

clusterMaker: a multi-algorithm clustering plugin for Cytoscape

Wilcoxon Rank-Based Tests for Clustered Data with R Package clusrank

Cluster Analysis of Medical Research Data using R

Clustering -- Basic concepts and methods

ggClusterNet: An R package for microbiome network analysis and modularity‐based multiple network layouts

A toolbox for fuzzy clustering using the R programming language

clusterProfiler: an R Package for Comparing Biological Themes Among Gene Clusters

An Advanced Cluster Analysis Method Based on Statistical Test

mdendro: An R package for extended agglomerative hierarchical clustering

dendextend: an R package for visualizing, adjusting and comparing trees of hierarchical clustering

clustifyr: an R package for automated single-cell RNA sequencing cluster classification

Clusterwise Functional Linear Regression Models.

rCOSA: A Software Package for Clustering Objects on Subsets of Attributes