A Graph Multi-separator Problem for Image Segmentation

Jannik Irmai,Shengxian Zhao,Jannik Presberger,Bjoern Andres
2023-07-10
Abstract:We propose a novel abstraction of the image segmentation task in the form of a combinatorial optimization problem that we call the multi-separator problem. Feasible solutions indicate for every pixel whether it belongs to a segment or a segment separator, and indicate for pairs of pixels whether or not the pixels belong to the same segment. This is in contrast to the closely related lifted multicut problem where every pixel is associated to a segment and no pixel explicitly represents a separating structure. While the multi-separator problem is NP-hard, we identify two special cases for which it can be solved efficiently. Moreover, we define two local search algorithms for the general case and demonstrate their effectiveness in segmenting simulated volume images of foam cells and filaments.
Computer Vision and Pattern Recognition,Discrete Mathematics
What problem does this paper attempt to address?
The paper attempts to address the problem of proposing a new form of combinatorial optimization problem in image segmentation tasks, namely the multi-separator problem. Specifically, this problem aims to determine whether each pixel belongs to a segment or a segment separator, and for pixel pairs, to determine whether they belong to the same segment. This is different from the existing lifted multicut problem, where each pixel is associated with a segment without an explicit separator structure. The main contributions of the paper include: 1. **Theoretical Analysis**: A theoretical framework for the multi-separator problem is proposed, and its complexity is analyzed. 2. **Algorithm Design**: Two local search algorithms are defined to efficiently find local optimal solutions to the multi-separator problem. 3. **Experimental Validation**: These algorithms are applied to volumetric images of simulated foam cells and fibers, evaluating their accuracy and computation time in image segmentation tasks. Through these contributions, the paper aims to provide a new approach to handling image segmentation tasks, especially in cases where an explicit representation of separator structures is needed, such as the segmentation of foam cells and fibers.