Abstract:There is a rich literature on clustering functional data with applications to time-series modeling, trajectory data, and even spatio-temporal applications. However, existing methods routinely perform global clustering that enforces identical atom values within the same cluster. Such grouping may be inadequate for high-dimensional functions, where the clustering patterns may change between the more dominant high-level features and the finer resolution local features. While there is some limited literature on local clustering approaches to deal with the above problems, these methods are typically not scalable to high-dimensional functions, and their theoretical properties are not well-investigated. Focusing on basis expansions for high-dimensional functions, we propose a flexible non-parametric Bayesian approach for multi-resolution clustering. The proposed method imposes independent Dirichlet process (DP) priors on different subsets of basis coefficients that ultimately results in a product of DP mixture priors inducing local clustering. We generalize the approach to incorporate spatially correlated error terms when modeling random spatial functions to provide improved model fitting. An efficient Markov chain Monte Carlo (MCMC) algorithm is developed for implementation. We show posterior consistency properties under the local clustering approach that asymptotically recovers the true density of random functions. Extensive simulations illustrate the improved clustering and function estimation under the proposed method compared to classical approaches. We apply the proposed approach to a spatial transcriptomics application where the goal is to infer clusters of genes with distinct spatial patterns of expressions. Our method makes an important contribution by expanding the limited literature on local clustering methods for high-dimensional functions with theoretical guarantees.
What problem does this paper attempt to address?
### What problem does this paper attempt to solve?
This paper aims to address the limitations of high - dimensional function data (such as spatio - temporal data) in cluster analysis. Specifically, existing global clustering methods usually force all elements within the same cluster to have the same feature values, which may not be flexible enough when dealing with high - dimensional functions and fails to capture local feature changes at different resolutions. Moreover, existing methods have problems of high computational complexity and imperfect theoretical properties when extended to high - dimensional functions.
To meet these challenges, the authors propose a new Bayesian non - parametric product mixture model for multi - scale functional clustering. This method achieves local clustering by introducing independent Dirichlet Process (DP) priors to model the basis coefficients at different resolutions. This method not only improves computational efficiency but also theoretically guarantees posterior consistency.
### Main contributions
1. **Local clustering to deal with the curse of dimensionality**:
- Use independent Dirichlet Process priors to model the basis coefficients at different resolutions, divide the parameter space into multiple subsets, and thus achieve local clustering.
- This method reduces the dimension, lowers the computational complexity, and can better capture local features in high - dimensional functions.
2. **Theoretical guarantee based on posterior consistency**:
- Under mild assumptions, establish the posterior consistency of density estimation, ensuring that the model can accurately recover the true random function density in the case of large samples.
3. **Inclusion of correlated noise**:
- The framework considers the correlated noise term (including independent error as a special case), allowing more flexible description of local perturbations unrelated to clustering and can adapt to the heterogeneity between different individuals.
4. **Efficient MCMC algorithm**:
- Develop an efficient Markov Chain Monte Carlo (MCMC) algorithm suitable for the model implementation of functions in high - dimensional space.
### Application examples
This method is applied to spatial transcriptomics data, aiming to infer the spatial pattern clustering of gene expression in breast cancer research. Experimental results show that this method outperforms traditional global clustering methods in clustering performance and can provide interpretable and reproducible gene clustering results.
### Formula display
- **Model representation**:
\[
y_i(v)=\theta_i(v)+\epsilon_{iv}, \quad v\in V
\]
where \(\theta_i(v)\) is the latent random function and \(\epsilon_{iv}\) is the measurement error.
- **Wavelet basis expansion**:
\[
\theta_i(v)=\phi(v)\alpha_i+\sum_{j = 0}^{\infty}\psi_j(v)^T\beta_{ij}
\]
where \(\phi(v)\) is the scaling function, \(\psi_j(v)\) is the wavelet basis function vector of the \(j\)-th layer resolution, and \(\beta_{ij}\) is the corresponding wavelet basis coefficient.
- **Dirichlet Process prior**:
\[
\beta_{ij}\sim P_j, \quad P_j\sim\text{DP}(\alpha_j, P_j^*)
\]
where \(\alpha_j\) is the concentration parameter and \(P_j^*\) is the base measure of the Dirichlet process.
Through these improvements, this paper provides a new solution for local clustering of high - dimensional function data and has made significant progress in theory and application.