Flow updates for domain decomposition of entropic optimal transport

Ismael Medina,Bernhard Schmitzer

2024-05-15

Abstract:Domain decomposition has been shown to be a computationally efficient distributed method for solving large scale entropic optimal transport problems. However, a naive implementation of the algorithm can freeze in the limit of very fine partition cells (i.e.~it asymptotically becomes stationary and does not find the global minimizer), since information can only travel slowly between cells. In practice this can be avoided by a coarse-to-fine multiscale scheme. In this article we introduce flow updates as an alternative approach. Flow updates can be interpreted as a variant of the celebrated algorithm by Angenent, Haker, and Tannenbaum, and can be combined canonically with domain decomposition. We prove convergence to the global minimizer and provide a formal discussion of its continuity limit. We give a numerical comparison with naive and multiscale domain decomposition, and show that the hybrid method does not suffer from freezing in the regime of very many cells. While the multiscale scheme is observed to be faster than the hybrid approach in general, the latter could be a viable alternative in cases where a good initial coupling is available. Our numerical experiments are based on a novel GPU implementation of domain decomposition that we describe in the appendix.

Numerical Analysis

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper "Flow updates for domain decomposition of entropic optimal transport" aims to address the issue of domain decomposition algorithms getting stuck in local optima (i.e., the "freezing" phenomenon) when dealing with large-scale entropic optimal transport problems under fine-grained partitioning.

Specifically, the paper points out:

1. **Limitations of Domain Decomposition Algorithms**:
- Domain decomposition is a computationally efficient distributed method suitable for solving large-scale entropic optimal transport problems.
- However, when the partitioning is very fine, the speed of information transfer between different units becomes very slow, causing the algorithm to potentially fail to find the global optimal solution and instead get stuck in local optima.

2. **Existing Solutions**:
- The current method is to use a multi-scale scheme to avoid the freezing phenomenon, but this method may not be as efficient as other methods in some cases.

3. **Proposed New Method**:
- The paper introduces "flow updates" as an alternative method. Flow updates can be seen as a variant of the famous algorithm proposed by Angenent, Haker, and Tannenbaum, and can be combined with the domain decomposition method.
- Flow updates reduce the non-local curl in the transport plan through global optimization steps, thereby avoiding the freezing phenomenon.

4. **Main Contributions**:
- Proving that the flow update method can converge to the global optimal solution.
- Providing a discussion on the formal continuous limit of the flow update method.
- Comparing the flow update method with traditional single-scale and multi-scale domain decomposition methods through numerical experiments, demonstrating the advantages of the flow update method at high resolutions.

In summary, the paper aims to improve the robustness and efficiency of domain decomposition algorithms in handling large-scale entropic optimal transport problems by introducing the flow update method, particularly in avoiding the freezing phenomenon under fine-grained partitioning.