Abstract:Semantic segmentation is one of the most important tasks in remote sensing. However, as spatial resolution increases, distinguishing the homogeneity of each land class and the heterogeneity between different land classes are challenging. The Markov random field model (MRF) is a widely used method for semantic segmentation due to its effective spatial context description. To improve segmentation accuracy, some MRF-based methods extract more image information by constructing the probability graph with pixel or object granularity units, and some other methods interpret the image from different semantic perspectives by building multilayer semantic classes. However, these MRF-based methods fail to capture the relationship between different granularity features extracted from the image and hierarchical semantic classes that need to be interpreted. In this article, a new MRF-based method is proposed to incorporate the multigranularity information and the multilayer semantic classes together for semantic segmentation of remote sensing images. The proposed method develops a framework that builds a hybrid probability graph on both pixel and object granularities and defines a multiclass-layer label field with hierarchical semantic over the hybrid probability graph. A generative alternating granularity inference is suggested to provide the result by iteratively passing and updating information between different granularities and hierarchical semantics. The proposed method is tested on texture images, different remote sensing images obtained by the SPOT5, Gaofen-2, GeoEye, and aerial sensors, and Pavia University hyperspectral image. Experiments demonstrate that the proposed method shows a better segmentation performance than other state-of-the-art methods.

A visual mechanism inspired model for image segmentation

Video Object Segmentation Based on MRF Model Using Wavelet Transform

Vibration-resisted video segmentation algorithm based on hierarchical Markov random field model

An Image Segmentation Algorithm Based on Improved Multiscale Random Field Model in Wavelet Domain

Stable Underwater Image Segmentation in High Quality Via MRF Model

Object-Based and Semantic Image Segmentation Using MRF

A Methodology of Image Segmentation for High Resolution Remote Sensing Image Based on Visual System and Markov Random Field

Image Segmentation Based on Multiscale Markov Random Field

Supervised Image Segmentation Based on Tree-Structured MRF Model in Wavelet Domain

A Graphical Model Framework For Image Segmentation

Mrf Model and Frame Model-Based Unsupervised Image Segmentation

A New Localized Superpixel Markov Random Field for Image Segmentation

Interesting moving object segmentation based on selective visual attention and Markov random field

VBI-MRF Model for Image Segmentation

MCMC algorithm based on Markov random field in image segmentation

Image Segmentation Based on High-Order MRF Model with Robust Local Spatial Information

Image Segmentation Based on Markov Random Field with Ant Colony System

A graphical model framework for coupling MRFs and deformable models

Image Segmentation Based on Local Spatial Adaptive Markov Random Field Model

Multigranularity Multiclass-Layer Markov Random Field Model for Semantic Segmentation of Remote Sensing Images

Interactive region-based MRF image segmentation