Abstract:This paper proposes an unsupervised color–texture image segmentation method. In order to enhance the effects of segmentation, a new color–texture descriptor is designed by integrating the compact multi-scale structure tensor (MSST), total variation (TV) flow, and the color information. Due to the fact that MSST does not work well for separating regions with large-scale texture, the total variation flow is used to auxiliarily describe the texture feature by extracting local scale information. To segment the color–texture image in an unsupervised and multi-label way, the multivariate mixed student's t-distribution (MMST) is chosen for probability distribution modeling, as MMST can describe the distribution of color–texture features accurately. Since the valid class number is hard to adaptively determine in advance, a component-wise expectation–maximization for MMST (CEM3ST) algorithm is proposed, which can effectively initialize the valid class number. Then, we can build up the energy functional according to the valid class number, and optimize it by multilayer graph cuts method. However, the problem of over/error-segmentation often happens. To overcome this problem, a strategy of regional credibility merging (RCM) is presented by integrating the regional adjacency relationship, region size, common edge between regions, and regional color–texture dissimilarity. In order to terminate the whole segmentation process, an adaptive iteration convergence criterion is designed, which combines the negative logarithm of probability of all color–texture features with the Kullback–Leibler (KL) divergence for MMST. Experiments using a large number of synthesis color–texture images and real natural scene images demonstrate the superiority of our proposed method, such as the effective over/error-segmentation reduction, high segmentation accuracy, and outperforming visual entirety/consistency.

Multiclass color-texture image segmentation based on random walks framework integrating compact texture information

Multi-Level Feature Descriptor for Robust Texture Classification via Locality-Constrained Collaborative Strategy

Image Segmentation Based on GrabCut Framework Integrating Multiscale Nonlinear Structure Tensor

Unsupervised Multiphase Color-Texture Image Segmentation Based on Variational Formulation and Multilayer Graph.

Multilayer Graph Cuts Based Unsupervised Color–texture Image Segmentation Using Multivariate Mixed Student's T-Distribution and Regional Credibility Merging

Texture Segmentation Using Independent-Scale Component-Wise Riemannian-Covariance Gaussian Mixture Model in Kl Measure Based Multi-Scale Nonlinear Structure Tensor Space

Color-texture Cosegmentation Based on Nonlinear Compact Multi-Scale Structure Tensor and TV-flow.

Texture Image Segmentation Using Statistical Active Contours

A Study Of Regional Distributions And Dissimilarity Measures For Multi-Scale Nonlinear Structure Tensor In Texture Segmentation

Textural image segmentation with multi-scale wavelet analysis based on feature learning

Unsupervised Color-Texture Segmentation Based on Multiscale Quaternion Gabor Filters and Splitting Strategy.

BoW-MSN: A Novel Texture Classification Approach.

Texture Segmentation Using Kernel-based Techniques

A Multiscale Texture Image Segmentation Algorithm Based on Adaptive Window Fixing and Propagation

TEXTURE IMAGE SEGMENTATION BASED ON NON-DOWN SAMPLING CONTOURLET AND MARKOV RANDOM FIELD

Texture image segmentation: an interactive framework based on adaptive features and transductive learning

Color Texture Segmentation Based on Active Contour Model with Multichannel Nonlocal and Tikhonov Regularization

Color Texture Image Segmentation Using Chromatic Statistical Landscape Features

Statistical Multisensor Image Segmentation In Complex Wavelet Domains

Markov Random Field Based Dynamic Texture Segmentation Using Inter-Scale Context

Image Segmentation Based on Self-supervised Classification and Multispace KL Transform