Abstract:This paper proposes an unsupervised color–texture image segmentation method. In order to enhance the effects of segmentation, a new color–texture descriptor is designed by integrating the compact multi-scale structure tensor (MSST), total variation (TV) flow, and the color information. Due to the fact that MSST does not work well for separating regions with large-scale texture, the total variation flow is used to auxiliarily describe the texture feature by extracting local scale information. To segment the color–texture image in an unsupervised and multi-label way, the multivariate mixed student's t-distribution (MMST) is chosen for probability distribution modeling, as MMST can describe the distribution of color–texture features accurately. Since the valid class number is hard to adaptively determine in advance, a component-wise expectation–maximization for MMST (CEM3ST) algorithm is proposed, which can effectively initialize the valid class number. Then, we can build up the energy functional according to the valid class number, and optimize it by multilayer graph cuts method. However, the problem of over/error-segmentation often happens. To overcome this problem, a strategy of regional credibility merging (RCM) is presented by integrating the regional adjacency relationship, region size, common edge between regions, and regional color–texture dissimilarity. In order to terminate the whole segmentation process, an adaptive iteration convergence criterion is designed, which combines the negative logarithm of probability of all color–texture features with the Kullback–Leibler (KL) divergence for MMST. Experiments using a large number of synthesis color–texture images and real natural scene images demonstrate the superiority of our proposed method, such as the effective over/error-segmentation reduction, high segmentation accuracy, and outperforming visual entirety/consistency.

Image Segmentation Using Local Spectral Histograms and Linear Regression

Rough-fuzzy set approach for color and texture based image segmentation

Remote Sensing Image Segmentation by Combining Spectral and Texture Features

Image Segmentation Based On Local Fourier Coefficients Histogram

Texture Segmentation Using Kernel-based Techniques

Texture Image Segmentation Using Spectral Clustering.

Multilayer Graph Cuts Based Unsupervised Color–texture Image Segmentation Using Multivariate Mixed Student's T-Distribution and Regional Credibility Merging

A Spectral-Texture Kernel-Based Classification Method for Hyperspectral Images.

Image Segmentation Based on Fussing Multi-feature and Spatial Spectral Clustering

Texture Image Segmentation Using Affinity Propagation And Spectral Clustering

Color Texture Image Segmentation Using Chromatic Statistical Landscape Features

A Segmentation Method of Color Texture Image

Unsupervised Image Segmentation Based On Contourlet Texture Features And Byy Harmony Learning Of T-Mixtures

Histogram-based Image Segmentation Using Variational Mode Decomposition and Correlation Coefficients

Texture segmentation based on combination of second-order features and spatial information

Color-texture Image Segmentation by Combining Region and Photometric Invariant Edge Information

A Spectral Clustering Image Segmentation Algorithm Based on Nyström Approximation

Color Image Segmentation Using Pixel Wise Support Vector Machine Classification.

Color Image Segmentation Using Mean Shift and Improved Spectral Clustering

Robust Image Segmentation Using LBP Embedded Region Merging

Unsupervised Color-Texture Image Segmentation