Abstract:Abstract Background Clustering is a fundamental problem in statistics and has broad applications in various areas. Traditional clustering methods treat features equally and ignore the potential structure brought by the characteristic difference of features. Especially in cancer diagnosis and treatment, several types of biological features are collected and analyzed together. Treating these features equally fails to identify the heterogeneity of both data structure and cancer itself, which leads to incompleteness and inefficacy of current anti-cancer therapies. Objectives In this paper, we propose a clustering framework based on hierarchical heterogeneous data with prior pairwise relationships. The proposed clustering method fully characterizes the difference of features and identifies potential hierarchical structure by rough and refined clusters. Results The refined clustering further divides the clusters obtained by the rough clustering into different subtypes. Thus it provides a deeper insight of cancer that can not be detected by existing clustering methods. The proposed method is also flexible with prior information, additional pairwise relationships of samples can be incorporated to help to improve clustering performance. Finally, well-grounded statistical consistency properties of our proposed method are rigorously established, including the accurate estimation of parameters and determination of clustering structures. Conclusions Our proposed method achieves better clustering performance than other methods in simulation studies, and the clustering accuracy increases with prior information incorporated. Meaningful biological findings are obtained in the analysis of lung adenocarcinoma with clinical imaging data and omics data, showing that hierarchical structure produced by rough and refined clustering is necessary and reasonable.

The Semi-Hierarchical Dirichlet Process and Its Application to Clustering Homogeneous Distributions

Hierarchical Mixture of Finite Mixtures

Central limit theorems associated with the hierarchical Dirichlet process

Sharing clusters among related groups: Hierarchical Dirichlet processes

Latent nested nonparametric priors

Inferring Hierarchical Mixture Structures: A Bayesian Nonparametric Approach

Powered Dirichlet Process for Controlling the Importance of "Rich-Get-Richer" Prior Assumptions in Bayesian Clustering

Beta-Product Poisson-Dirichlet Processes

Truncated Poisson–Dirichlet approximation for Dirichlet process hierarchical models

Regression Tree and Clustering for Distributions, and Homogeneous Structure of Population Characteristics

Fair Clustering via Hierarchical Fair-Dirichlet Process

Individual Heterogeneity Learning in Distributional Data Response Additive Models

Clustering on hierarchical heterogeneous data with prior pairwise relationships

A multiscale Bayesian nonparametric framework for partial hierarchical clustering

Dirichlet Process Parsimonious Mixtures for clustering

Hierarchical Dirichlet Processes with Social Influence

Dirichlet Process Mixture Models for Modeling and Generating Synthetic Versions of Nested Categorical Data

Sparse Bayesian Hierarchical Modeling of High-dimensional Clustering Problems

Hierarchical beta processes and the Indian buffet process

Clustering Mixed-Type Data via Dirichlet Process Mixture Model with Cluster-Specific Covariance Matrices

Clustering spatial functional data using a geographically weighted Dirichlet process