Abstract:We introduce the concept of mixture inner product spaces associated with a given separable Hilbert space, which feature an infinite-dimensional mixture of finite-dimensional vector spaces and are dense in the underlying Hilbert space. Any Hilbert valued random element can be arbitrarily closely approximated by mixture inner product space valued random elements. While this concept can be applied to data in any infinite-dimensional Hilbert space, the case of functional data that are random elements in the L space of square integrable functions is of special interest. For functional data, mixture inner product spaces provide a new perspective, where each realization of the underlying stochastic process falls into one of the component spaces and is represented by a finite number of basis functions, the number of which corresponds to the dimension of the component space. In the mixture representation of functional data, the number of included mixture components used to represent a given random element in L is specifically adapted to each random trajectory and may be arbitrarily large. Key benefits of this novel approach are, first, that it provides a new perspective on the construction of a probability density in function space under mild regularity conditions, and second, that individual trajectories possess a trajectory-specific dimension that corresponds to a latent random variable, making it possible to use a larger number of components for less smooth and a smaller number for smoother trajectories. This enables flexible and parsimonious modeling of heterogeneous trajectory shapes. We establish estimation consistency of the functional mixture density and introduce an algorithm for fitting the functional mixture model based on a modified expectation-maximization algorithm. Simulations confirm that in comparison to traditional functional principal component analysis the proposed method achieves similar or better data recovery while using fewer components on average. Its practical merits are also demonstrated in an analysis of egg-laying trajectories for medflies.

Convex Approximation to the Integral Mixture Models Using Step Functions

Bayesian estimation and prediction for certain mixtures

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Conditional mixture modeling and model-based clustering

Parameter estimation for Choquet fuzzy integral based on Takagi–Sugeno fuzzy model

A Nonparametric Estimation Method for the Multivariate Mixture Models

Estimating Mixture of Gaussian Processes by Kernel Smoothing

Dose-Response Curve Estimation: A Semiparametric Mixture Approach

Asymptotic Properties of Nonparametric M-Estimation for Mixing Functional Data

Roduct s paces and t heir a pplication to f unctional d ata a nalysis

A novel approach for parameter estimation of mixture of two Weibull distributions in failure data modeling

Ultra-Fast Approximate Inference Using Variational Functional Mixed Models

Estimating the Number of Components in Finite Mixture Models via Variational Approximation

On Parameter Estimation in Deviated Gaussian Mixture of Experts

Probabilistic Inference from Arbitrary Uncertainty using Mixtures of Factorized Generalized Gaussians

The Informativeness of K -Means for Learning Mixture Models

Factor Model of Mixtures

Parsimony and parameter estimation for mixtures of multivariate leptokurtic-normal distributions

Finite Mixture Models with Negative Components.

Full-model estimation for non-parametric multivariate finite mixture models