Abstract:There is a rich literature on clustering functional data with applications to time-series modeling, trajectory data, and even spatio-temporal applications. However, existing methods routinely perform global clustering that enforces identical atom values within the same cluster. Such grouping may be inadequate for high-dimensional functions, where the clustering patterns may change between the more dominant high-level features and the finer resolution local features. While there is some limited literature on local clustering approaches to deal with the above problems, these methods are typically not scalable to high-dimensional functions, and their theoretical properties are not well-investigated. Focusing on basis expansions for high-dimensional functions, we propose a flexible non-parametric Bayesian approach for multi-resolution clustering. The proposed method imposes independent Dirichlet process (DP) priors on different subsets of basis coefficients that ultimately results in a product of DP mixture priors inducing local clustering. We generalize the approach to incorporate spatially correlated error terms when modeling random spatial functions to provide improved model fitting. An efficient Markov chain Monte Carlo (MCMC) algorithm is developed for implementation. We show posterior consistency properties under the local clustering approach that asymptotically recovers the true density of random functions. Extensive simulations illustrate the improved clustering and function estimation under the proposed method compared to classical approaches. We apply the proposed approach to a spatial transcriptomics application where the goal is to infer clusters of genes with distinct spatial patterns of expressions. Our method makes an important contribution by expanding the limited literature on local clustering methods for high-dimensional functions with theoretical guarantees.

Bayesian approach to clustering real value, categorical and network data: solution via variational methods

A Variational Bayesian Framework for Cluster Analysis in a Complex Network

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Optimal Bayesian estimators for latent variable cluster models

Bayesian Clustering with Variable and Transformation Selections

Bayesian model-based clustering for populations of network data

Revisiting k-means: New Algorithms via Bayesian Nonparametrics

Bayesian Nonparametric Graph Clustering

A Variational Approach to Bayesian Phylogenetic Inference

Variational Bayes Approximations for Clustering via Mixtures of Normal Inverse Gaussian Distributions

Bayesian Inference Via Variational Approximation for Collaborative Filtering.

Clustering of non-Gaussian data by variational Bayes for normal inverse Gaussian mixture models

A Bayesian Approach to Clustering Matting Components in Spectral Matting

Variational Inference for Latent Space Models for Dynamic Networks

Variational Inference: Posterior Threshold Improves Network Clustering Accuracy in Sparse Regimes

A multiscale Bayesian nonparametric framework for partial hierarchical clustering

Variational learning of hierarchical infinite generalized Dirichlet mixture models and applications

Clustering of heterogeneous populations of networks

Flexible Bayesian Nonparametric Product Mixtures for Multi-scale Functional Clustering

A generalized Bayes framework for probabilistic clustering

A Bayesian approach for clustering skewed data using mixtures of multivariate normal-inverse Gaussian distributions