Abstract:The Gromov-Wasserstein (GW) distance is frequently used in machine learning to compare distributions across distinct metric spaces. Despite its utility, it remains computationally intensive, especially for large-scale problems. Recently, a novel Wasserstein distance specifically tailored for Gaussian mixture models (GMMs) and known as MW2 (mixture Wasserstein) has been introduced by several authors. In scenarios where data exhibit clustering, this approach simplifies to a small-scale discrete optimal transport problem, which complexity depends solely on the number of Gaussian components in the GMMs. This paper aims to incorporate invariance properties into MW2. This is done by introducing new Gromov-type distances, designed to be isometry-invariant in Euclidean spaces and applicable for comparing GMMs across different dimensional spaces. Our first contribution is the Mixture Gromov Wasserstein distance (MGW2), which can be viewed as a "Gromovized" version of MW2. This new distance has a straightforward discrete formulation, making it highly efficient for estimating distances between GMMs in practical applications. To facilitate the derivation of a transport plan between GMMs, we present a second distance, the Embedded Wasserstein distance (EW2). This distance turns out to be closely related to several recent alternatives to Gromov-Wasserstein. We show that EW2 can be adapted to derive a distance as well as optimal transportation plans between GMMs. We demonstrate the efficiency of these newly proposed distances on medium to large-scale problems, including shape matching and hyperspectral image color transfer.

Gaussian Mixture Reduction with Composite Transportation Divergence

A revision for gaussian mixture density decomposition algorithm

Gaussian mixture density modeling and decomposition with weighted likelihood

Optimal Reduction of Multivariate Dirac Mixture Densities

Optimal transport for Gaussian mixture models

Gromov-Wasserstein-like Distances in the Gaussian Mixture Models Space

Incremental learning of Gaussian mixture model: A top-down algorithm

Learning-based Gaussian Mixture Reduction for Distributed Bayesian Filter.

Scalable fusion with mixture distributions in sensor networks

Clustering Gaussian Mixture Reduction Algorithm Based on Fuzzy Adaptive Resonance Theory for Extended Target Tracking

Analysis of multivariate Gaussian mixture model based on DRJMCMC method

Composite Inference for Gaussian Processes

Learning Gaussian Mixtures Using the Wasserstein-Fisher-Rao Gradient Flow

Convergence of Gradient EM on Multi-component Mixture of Gaussians.

Go With the Flow: Fast Diffusion for Gaussian Mixture Models

Mixture of Gaussian Processes and its Applications

A General Transfer Learning-based Gaussian Mixture Model for Clustering

Optimal Transport for Kernel Gaussian Mixture Models

Gaussian Mixture Reduction Based on Fuzzy ART for Extended Target Tracking

Efficient Volume Exploration Using the Gaussian Mixture Model

Gaussian Mixture Solvers for Diffusion Models