Abstract:The Gromov-Wasserstein (GW) distance is frequently used in machine learning to compare distributions across distinct metric spaces. Despite its utility, it remains computationally intensive, especially for large-scale problems. Recently, a novel Wasserstein distance specifically tailored for Gaussian mixture models (GMMs) and known as MW2 (mixture Wasserstein) has been introduced by several authors. In scenarios where data exhibit clustering, this approach simplifies to a small-scale discrete optimal transport problem, which complexity depends solely on the number of Gaussian components in the GMMs. This paper aims to incorporate invariance properties into MW2. This is done by introducing new Gromov-type distances, designed to be isometry-invariant in Euclidean spaces and applicable for comparing GMMs across different dimensional spaces. Our first contribution is the Mixture Gromov Wasserstein distance (MGW2), which can be viewed as a "Gromovized" version of MW2. This new distance has a straightforward discrete formulation, making it highly efficient for estimating distances between GMMs in practical applications. To facilitate the derivation of a transport plan between GMMs, we present a second distance, the Embedded Wasserstein distance (EW2). This distance turns out to be closely related to several recent alternatives to Gromov-Wasserstein. We show that EW2 can be adapted to derive a distance as well as optimal transportation plans between GMMs. We demonstrate the efficiency of these newly proposed distances on medium to large-scale problems, including shape matching and hyperspectral image color transfer.

A Rigorous Link Between Self-Organizing Maps and Gaussian Mixture Models

Gaussian mixture density modeling and decomposition with weighted likelihood

Bayesian Self-Organising Map for Gaussian Mixtures

Gaussian Mixture Model with Local Consistency

Non-Euclidean Self-Organizing Maps

Local maxima in the likelihood of gaussian mixture models: Structural results and algorithmic consequences

On the equivalence between kernel self-organising maps and self-organising mixture density networks.

Refining Gaussian Mixture Model Based on Enhanced Manifold Learning.

Comparison of a Bayesian SOM with the EM Algorithm for Gaussian Mixtures

Gaussian Mixture Models with Rare Events.

Manifold Optimization for Gaussian Mixture Models

Gaussian Mixture Model with Rare Events

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

Interpreting self-organizing maps through space–time data models

A Riemannian Newton Trust-Region Method for Fitting Gaussian Mixture Models

Learning Gaussian Mixtures Using the Wasserstein-Fisher-Rao Gradient Flow

Nearest-Neighbor Mixture Models for Non-Gaussian Spatial Processes

Gromov-Wasserstein-like Distances in the Gaussian Mixture Models Space

Manifold Regularized Gaussian Mixture Model for Semi-supervised Clustering.