Abstract:The Gromov-Wasserstein (GW) distance is frequently used in machine learning to compare distributions across distinct metric spaces. Despite its utility, it remains computationally intensive, especially for large-scale problems. Recently, a novel Wasserstein distance specifically tailored for Gaussian mixture models (GMMs) and known as MW2 (mixture Wasserstein) has been introduced by several authors. In scenarios where data exhibit clustering, this approach simplifies to a small-scale discrete optimal transport problem, which complexity depends solely on the number of Gaussian components in the GMMs. This paper aims to incorporate invariance properties into MW2. This is done by introducing new Gromov-type distances, designed to be isometry-invariant in Euclidean spaces and applicable for comparing GMMs across different dimensional spaces. Our first contribution is the Mixture Gromov Wasserstein distance (MGW2), which can be viewed as a "Gromovized" version of MW2. This new distance has a straightforward discrete formulation, making it highly efficient for estimating distances between GMMs in practical applications. To facilitate the derivation of a transport plan between GMMs, we present a second distance, the Embedded Wasserstein distance (EW2). This distance turns out to be closely related to several recent alternatives to Gromov-Wasserstein. We show that EW2 can be adapted to derive a distance as well as optimal transportation plans between GMMs. We demonstrate the efficiency of these newly proposed distances on medium to large-scale problems, including shape matching and hyperspectral image color transfer.

Gaussian mixture density modeling and decomposition with weighted likelihood

A revision for gaussian mixture density decomposition algorithm

Mixture of Gaussian Processes and its Applications

Mixture Gaussian Process Model with Gaussian Mixture Distribution for Big Data

The EM Algorithm for Generalized Exponential Mixture Model

An Entropy Weighting Mixture Model for Subspace Clustering of High-Dimensional Data

Robust Fitting of Mixture Models using Weighted Complete Estimating Equations

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

Unsupervised Learning of Gaussian Mixture Model with Application to Image Segmentation

An Improved Mixture Model of Gaussian Processes and Its Classification Expectation–Maximization Algorithm

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Gaussian Mixture Reduction with Composite Transportation Divergence

A Maximum Weighted Likelihood Approach To Simultaneous Model Selection And Feature Weighting In Gaussian Mixture

A generalized Budan-Fourier approach to generalized Gaussian and exponential mixtures

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

Learning GMM Using Elliptically Contoured Distributions

Gromov-Wasserstein-like Distances in the Gaussian Mixture Models Space

Local maxima in the likelihood of gaussian mixture models: Structural results and algorithmic consequences

On the properties of Gaussian Copula Mixture Models

Why Mixture?