Abstract:We introduce the concept of mixture inner product spaces associated with a given separable Hilbert space, which feature an infinite-dimensional mixture of finite-dimensional vector spaces and are dense in the underlying Hilbert space. Any Hilbert valued random element can be arbitrarily closely approximated by mixture inner product space valued random elements. While this concept can be applied to data in any infinite-dimensional Hilbert space, the case of functional data that are random elements in the L space of square integrable functions is of special interest. For functional data, mixture inner product spaces provide a new perspective, where each realization of the underlying stochastic process falls into one of the component spaces and is represented by a finite number of basis functions, the number of which corresponds to the dimension of the component space. In the mixture representation of functional data, the number of included mixture components used to represent a given random element in L is specifically adapted to each random trajectory and may be arbitrarily large. Key benefits of this novel approach are, first, that it provides a new perspective on the construction of a probability density in function space under mild regularity conditions, and second, that individual trajectories possess a trajectory-specific dimension that corresponds to a latent random variable, making it possible to use a larger number of components for less smooth and a smaller number for smoother trajectories. This enables flexible and parsimonious modeling of heterogeneous trajectory shapes. We establish estimation consistency of the functional mixture density and introduce an algorithm for fitting the functional mixture model based on a modified expectation-maximization algorithm. Simulations confirm that in comparison to traditional functional principal component analysis the proposed method achieves similar or better data recovery while using fewer components on average. Its practical merits are also demonstrated in an analysis of egg-laying trajectories for medflies.

Mixture of Gaussian Processes and its Applications

Gaussian mixture density modeling and decomposition with weighted likelihood

Estimating Mixture of Gaussian Processes by Kernel Smoothing

Mixture Gaussian Process Model with Gaussian Mixture Distribution for Big Data

Multimode Process Monitoring with PCA Mixture Model

A Robust Infinite Gaussian Mixture Model and Its Application in Fault Detection of Nonlinear Multimode Processes

Model selection of Gaussian mixture process and its application

Nearest-Neighbor Mixture Models for Non-Gaussian Spatial Processes

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

From Gaussian Processes to the Mixture of Gaussian Processes:A Survey

An Improved Mixture Model of Gaussian Processes and Its Classification Expectation–Maximization Algorithm

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

Roduct s paces and t heir a pplication to f unctional d ata a nalysis

Sampling-based Gaussian Mixture Regression for Big Data

The whole and its parts: Visualizing Gaussian mixture models

Differentiability and Approximation of Probability Functions under Gaussian Mixture Models: A Bayesian Approach

Fast deep mixtures of Gaussian process experts

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

Estimation of Subspace Arrangements with Applications in Modeling and Segmenting Mixed Data

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes