Abstract:In this paper, we present a superpixel segmentation algorithm called linear spectral clustering (LSC), which is capable of producing superpixels with both high boundary adherence and visual compactness for natural images with low computational costs. In LSC, a normalized cuts-based formulation of image segmentation is adopted using a distance metric that measures both the color similarity and the space proximity between image pixels. However, rather than directly using the traditional eigen-based algorithm, we approximate the similarity metric through a deliberately designed kernel function such that pixel values can be explicitly mapped to a high-dimensional feature space. We then apply the conclusion that by appropriately weighting each point in this feature space, the objective functions of the weighted K-means and the normalized cuts share the same optimum points. Consequently, it is possible to optimize the cost function of the normalized cuts by iteratively applying simple K-means clustering in the proposed feature space. LSC possesses linear computational complexity and high memory efficiency, since it avoids both the decomposition of the affinity matrix and the generation of the large kernel matrix. By utilizing the underlying mathematical equivalence between the two types of seemingly different methods, LSC successfully preserves global image structures through efficient local operations. Experimental results show that LSC performs as well as or even better than the state-of-the-art superpixel segmentation algorithms in terms of several commonly used evaluation metrics in image segmentation. The applicability of LSC is further demonstrated in two related computer vision tasks.

Superpixel Optimization Using Higher Order Energy

Adaptive Superpixel Segmentation Aggregating Local Contour and Texture Features

The Image Segmentation Based on Optimized Spatial Feature of Superpixel

High-Order Energies for Stereo Segmentation

A Graph Based Superpixel Generation Algorithm

Multi-scale Energy Optimization for Object Proposal Generation.

Superpixel Generation by Agglomerative Clustering with Quadratic Error Minimization

Superpixels with Content-Awareness Via a Two-Stage Generation Framework

Higher-Order Image Co-segmentation

An Efficient Hybrid Linear Clustering Superpixel Decomposition Framework for Traffic Scene Semantic Segmentation.

SSGD: Superpixels Using the Shortest Gradient Distance

Adaptive High-Precision Superpixel Segmentation

Texture Relative Superpixel Generation with Adaptive Parameters.

Superpixel Segmentation Based on Square-Wise Asymmetric Partition and Structural Approximation.

Superpixel Segmentation Using Linear Spectral Clustering

Fast and robust superpixel generation method

Linear Spectral Clustering Superpixel.

Semasuperpixel - A Multi-Channel Probability-Driven Superpixel Segmentation Method.

Cluster Sensing Superpixel and Grouping

Edge-aware texture filtering with superpixels constraint

Image retargeting based on global energy optimization