Discretization of Total Variation in Optimization with Integrality Constraints

Annika Schiemann,Paul Manns
2024-09-10
Abstract:We introduce discretizations of infinite-dimensional optimization problems with total variation regularization and integrality constraints on the optimization variables. We advance the discretization of the dual formulation of the total variation term with Raviart--Thomas functions which is known from literature for certain convex problems. Since we have an integrality constraint, the previous analysis from Caillaud and Chambolle [10] does not hold anymore. Even weaker $\Gamma$-convergence results do not hold anymore because the recovery sequences generally need to attain non-integer values to recover the total variation of the limit function. We solve this issue by introducing a discretization of the input functions on an embedded, finer mesh. A superlinear coupling of the mesh sizes implies an averaging on the coarser mesh of the Raviart--Thomas ansatz, which enables to recover the total variation of integer-valued limit functions with integer-valued discretized input functions. Moreover, we are able to estimate the discretized total variation of the recovery sequence by the total variation of its limit and an error depending on the mesh size ratio. For the discretized optimization problems, we additionally add a constraint that vanishes in the limit and enforces compactness of the sequence of minimizers, which yields their convergence to a minimizer of the original problem. This constraint contains a degree of freedom whose admissible range is determined. Its choice may have a strong impact on the solutions in practice as we demonstrate with an example from imaging.
Numerical Analysis,Optimization and Control
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to handle total variation regularization and integrality constraints simultaneously in optimization problems. Specifically, the researchers focus on how to discretize variables with integrality constraints in infinite - dimensional optimization problems, so that the total variation of the solution can be effectively recovered while maintaining the integrality constraints. This problem is very important in many practical applications, such as image denoising, deblurring, segmentation, etc. ### Specific description of the problem Consider the following optimization problem: \[ \min_{w \in L^1(\Omega)} F(w)+\alpha TV(w) \] Subject to: \[ w(x)\in W\subset\mathbb{Z}\quad\text{for almost all }x\in\Omega \] where: - $\Omega\subset\mathbb{R}^d$ is a bounded Lipschitz domain. - $W\subset\mathbb{Z}$ is a finite set of integers. - $\alpha > 0$ is a regularization parameter. - $TV:L^1(\Omega)\to[0,\infty]$ represents total variation. - $F:L^1(\Omega)\to\mathbb{R}$ is a continuous and bounded - below function. ### Main challenges 1. **Integrality constraints**: Due to the existence of integrality constraints, traditional analysis methods (such as Caillaud and Chambolle's methods) are no longer applicable because these methods usually rely on non - integer values to recover total variation. 2. **Discretization problem**: Many existing total variation discretization methods (such as the discretization based on Raviart - Thomas functions) cannot be directly applied to problems with integrality constraints because they require non - integer values to accurately recover total variation. ### Solution To solve the above problems, the author proposes a new discretization method by introducing two coupled grids: - **Fine grid**: Used to discretize the input function $w$, ensuring that its values are always integers. - **Coarse grid**: Used to discretize the total variation term, ensuring that the total variation of the integer - valued function can be recovered. In this way, even if the integrality constraints are maintained on the fine grid, the total variation can be recovered on the coarse grid through the averaging effect. In addition, the author also introduces an additional constraint condition to ensure the compactness of the minimizing sequence and proves that the minimum solution of the discretization problem converges to the minimum solution of the original problem as the grid size approaches zero. ### Conclusion The main contribution of this paper is to provide an effective method that can correctly discretize and solve infinite - dimensional optimization problems with total variation regularization while maintaining integrality constraints. This method not only solves theoretical problems but also has important significance in practical applications, such as in the field of image processing.