Abstract:Community detection is a powerful tool from complex networks analysis that finds applications in various research areas. Several image segmentation methods rely for instance on community detection algorithms as a black box in order to compute undersegmentations, i.e. a small number of regions that represent areas of interest of the image. However, to the best of our knowledge, the efficiency of such an approach w.r.t. superpixels, that aim at representing the image at a smaller level while preserving as much as possible original information, has been neglected so far. The only related work seems to be the one by Liu et. al. (IET Image Processing, 2022) that developed a superpixels algorithm using a so-called modularity maximization approach, leading to relevant results. We follow this line of research by studying the efficiency of superpixels computed by state-of-the-art community detection algorithms on a 4-connected pixel graph, so-called pixel-grid. We first detect communities on such a graph and then apply a simple merging procedure that allows to obtain the desired number of superpixels. As we shall see, such methods result in the computation of relevant superpixels as emphasized by both qualitative and quantitative experiments, according to different widely-used metrics based on ground-truth comparison or on superpixels only. We observe that the choice of the community detection algorithm has a great impact on the number of communities and hence on the merging procedure. Similarly, small variations on the pixel-grid may provide different results from both qualitative and quantitative viewpoints. For the sake of completeness, we compare our results with those of several state-of-the-art superpixels algorithms as computed by Stutz et al. (Computer Vision and Image Understanding, 2018).
What problem does this paper attempt to address?
### Problems Addressed by the Paper
This paper aims to explore the efficiency of community detection algorithms in generating superpixels. Specifically, the authors focus on how to utilize existing community detection algorithms to process 4-connected pixel grids to generate high-quality superpixels. Superpixels are an image segmentation technique that decomposes an image into smaller regions while preserving as much original information as possible. Although many image segmentation methods use community detection algorithms as black-box tools, these methods are usually not optimized specifically for superpixel generation. Moreover, current research rarely systematically evaluates the performance of community detection algorithms in superpixel generation.
### Main Contributions
1. **Algorithm Selection and Evaluation**: The authors selected three classic community detection algorithms (Label Propagation, Louvain, and InfoMap) and conducted experiments on the same 4-connected pixel grid to evaluate their effectiveness in generating superpixels.
2. **Merging Strategy**: A simple merging strategy is proposed to control the number of generated superpixels, allowing community detection algorithms to better adapt to the needs of superpixel generation.
3. **Performance Comparison**: By comparing with existing superpixel algorithms (such as SLIC, SEEDS, etc.), the paper demonstrates the performance of superpixels generated by community detection algorithms under various evaluation metrics.
4. **Parameter Impact Analysis**: The study investigates the impact of different parameters (such as pixel grid radius, similarity threshold, etc.) on the effectiveness of superpixel generation, providing detailed experimental results and analysis.
### Research Background
- **Applications of Superpixels**: Superpixels have wide applications in image segmentation, video analysis, object tracking, content-based image retrieval, biomedical imaging, and other fields.
- **Community Detection Algorithms**: Community detection algorithms were initially used for complex network analysis, aiming to group nodes in a network such that connections within groups are dense, while connections between groups are sparse.
- **Limitations of Existing Methods**: Although some methods attempt to use community detection algorithms for image segmentation, these methods are usually not optimized specifically for superpixel generation and lack systematic evaluation.
### Experimental Setup
- **Datasets**: Multiple standard datasets (such as BSDS500, SBD, NYUV2, SUNRGBD) were used for experiments.
- **Evaluation Metrics**: Metrics include Boundary Recall (Rec), Undersegmentation Error (UE), Explained Variation (EV), and Compactness (CO).
- **Parameter Selection**: Different pixel grid radii (r) and similarity thresholds (ρ) were used in the experiments, and an optimal combination (r=5, ρ=0.98) was selected for the main experiments.
### Experimental Results
- **Quantitative Comparison**: On multiple datasets, superpixels generated using InfoMap performed well across various evaluation metrics, especially in terms of Boundary Recall and Compactness.
- **Qualitative Comparison**: Visual results show the quality of the generated superpixels, with community detection algorithms demonstrating advantages in maintaining boundary consistency and region compactness compared to other methods.
### Conclusion
The authors demonstrate through experiments that using community detection algorithms to generate superpixels is an effective method, capable of achieving or surpassing the performance of existing methods across multiple evaluation metrics. Additionally, through reasonable parameter selection and merging strategies, the quality of generated superpixels can be further improved. Future work can explore other community detection algorithms and parameter settings to further optimize the effectiveness of superpixel generation.