Abstract:Semantic segmentation is one of the most important tasks in remote sensing. However, as spatial resolution increases, distinguishing the homogeneity of each land class and the heterogeneity between different land classes are challenging. The Markov random field model (MRF) is a widely used method for semantic segmentation due to its effective spatial context description. To improve segmentation accuracy, some MRF-based methods extract more image information by constructing the probability graph with pixel or object granularity units, and some other methods interpret the image from different semantic perspectives by building multilayer semantic classes. However, these MRF-based methods fail to capture the relationship between different granularity features extracted from the image and hierarchical semantic classes that need to be interpreted. In this article, a new MRF-based method is proposed to incorporate the multigranularity information and the multilayer semantic classes together for semantic segmentation of remote sensing images. The proposed method develops a framework that builds a hybrid probability graph on both pixel and object granularities and defines a multiclass-layer label field with hierarchical semantic over the hybrid probability graph. A generative alternating granularity inference is suggested to provide the result by iteratively passing and updating information between different granularities and hierarchical semantics. The proposed method is tested on texture images, different remote sensing images obtained by the SPOT5, Gaofen-2, GeoEye, and aerial sensors, and Pavia University hyperspectral image. Experiments demonstrate that the proposed method shows a better segmentation performance than other state-of-the-art methods.

An Efficient Texture Image Segmentation Algorithm Based on the GMRF Model for Classification of Remotely Sensed Imagery

Texture Segmentation Using Kernel-based Techniques

Segmentation Algorithm of Moving Object Based on Mean Field Theory and MRF-MAP

A Unified Model of GMRF and MOG for Image Segmentation

Texture Image Segmentation Based on Gaussian Mixture Models

A Spectral-Spatial Classification of Hyperspectral Images Based on the Algebraic Multigrid Method and Hierarchical Segmentation Algorithm

Multigranularity Multiclass-Layer Markov Random Field Model for Semantic Segmentation of Remote Sensing Images

Efficient video object segmentation based on Gaussian mixture model and Markov random field

Textured Image Segmentation Based on Multiresolution Wavelet and Gaussian Mixture Models

A Multiphase Texture Segmentation Method Based on Local Intensity Distribution and Potts Model

A New Textured Image Segmentation Algorithm Based on Gaussian Mixture Models

A Texture Segmentation Algorithm And Its Application To Target Recognition

Segmentation of High-Resolution Multispectral Image Based on Extended Morphological Profiles

Multispectral quickbird-2 image segmentation based on vector field model

Segmentation for High-Resolution Optical Remote Sensing Imagery Using Improved Quadtree and Region Adjacency Graph Technique

Edge-Guided Image Object Detection in Multiscale Segmentation for High-Resolution Remotely Sensed Imagery.

A New Algorithm for Remotely Sensed Image Texture Classification and Segmentation

Evaluating the Effects of Image Texture Analysis on Plastic Greenhouse Segments via Recognition of the OSI-USI-ETA-CEI Pattern

Improved Mean-Shift Segmentation Approach for Remote Sensing Images

A Multi-Source Remote Sensing Image Matching Approach Based on Texture-Enhanced Region Features

A Hierarchical Gamma Mixture Model Toward Hidden Markov Random Field for High-Resolution SAR Image Segmentation