Abstract:In this paper, we present a superpixel segmentation algorithm called linear spectral clustering (LSC), which is capable of producing superpixels with both high boundary adherence and visual compactness for natural images with low computational costs. In LSC, a normalized cuts-based formulation of image segmentation is adopted using a distance metric that measures both the color similarity and the space proximity between image pixels. However, rather than directly using the traditional eigen-based algorithm, we approximate the similarity metric through a deliberately designed kernel function such that pixel values can be explicitly mapped to a high-dimensional feature space. We then apply the conclusion that by appropriately weighting each point in this feature space, the objective functions of the weighted K-means and the normalized cuts share the same optimum points. Consequently, it is possible to optimize the cost function of the normalized cuts by iteratively applying simple K-means clustering in the proposed feature space. LSC possesses linear computational complexity and high memory efficiency, since it avoids both the decomposition of the affinity matrix and the generation of the large kernel matrix. By utilizing the underlying mathematical equivalence between the two types of seemingly different methods, LSC successfully preserves global image structures through efficient local operations. Experimental results show that LSC performs as well as or even better than the state-of-the-art superpixel segmentation algorithms in terms of several commonly used evaluation metrics in image segmentation. The applicability of LSC is further demonstrated in two related computer vision tasks.

Superpixels With Content-Adaptive Criteria

Superpixels with Content-Awareness Via a Two-Stage Generation Framework

Content-Sensitive Superpixel Generation with Boundary Adjustment

An experimental comparison of superpixels detection methods for contour detection

Adaptive hypergraph superpixels

Fast and robust superpixel generation method

High Quality Superpixel Generation Through Regional Decomposition

Manifold Preserving Color Editing Based on Superpixels.

Adaptive High-Precision Superpixel Segmentation

Fast and Effective Image Segmentation via Superpixels and Adaptive Thresholding.

Adaptive strategy for superpixel-based region-growing image segmentation

Content-Based Superpixel Segmentation and Matching Using Its Region Feature Descriptors.

Robust superpixels using color and contour features along linear path

Rethinking Superpixel Segmentation from Biologically Inspired Mechanisms

Manifold SLIC: A Fast Method to Compute Content-Sensitive Superpixels

Cluster-based fine-to-coarse superpixel segmentation

Cluster Sensing Superpixel and Grouping

CONIC: Contour Optimized Non-Iterative Clustering Superpixel Segmentation

Linear Spectral Clustering Superpixel.

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

Weakly supervised semantic segmentation based on superpixel affinity