Abstract:Deep convolutional neural networks (DCNNs) have been driving significant advances in semantic image segmentation due to their powerful feature representation for recognition. However, their performance in preserving object boundaries is still not satisfactory. Visual mechanism theory indicates that image segmentation tasks require not only recognition, like DCNNs, but also local visual attention capability. Considering that superpixel is good at grasping detailed local structure, we propose a probabilistic superpixel-based dense conditional random field model (PSP-CRF) to refine label assignments as a post-processing optimization method. First, the well-known fully convolutional networks (FCN) and Deeplab-ResNet are employed to produce coarse prediction probabilistic maps at each pixel. Second, we construct a fully connected CRF model based on the PSP generated by the simple linear iterative clustering algorithm. In our approach, an effective refining algorithm with entropy is developed to convert the pixel-level appearance and position features to the normalized PSP, which works well for CRF. Third, our method optimizes the PSP-CRF to obtain the final label assignment results by employing a highly efficient mean field inference algorithm and some quadratic programming relaxation related algorithms. The experiments on the PASCAL VOC segmentation dataset demonstrate the effectiveness of our methods which can improve the segmentation performance of DCNNs to 82% in mIoU while increasing the computational efficiency by 47%.

Superpixel-based Conditional Random Field for Image Classification

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

A conditional random field model for image parsing.

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

Conditional random field-based image labelling combining features of pixels, segments and regions

Scene Classification Based on Local Feature and Hidden Conditional Random Fields

Image labeling based on fully-connected conditional random field

Conditional Random Fields for Image Labeling

Superpixel-based Object Class Segmentation Using Conditional Random Fields.

Simplified Conditional Random Fields with Class Boundary Constraint for Spectral-Spatial Based Remote Sensing Image Classification

Context-based conditional random fields as recurrent neural networks for image labeling

Image Semantic Segmentation Optimization by Conditional Random Field Integrated with Object Clique Potential.

CRF Learning with CNN Features for Image Segmentation

Fast Algorithm Based on Superpixel‐level Conditional Triplet Markov Field for Successive‐approximation Resistor Image Segmentation

Combining watersheds and conditional random fields for image classification

Conditional Random Fields for Image Region Labeling with Global Observation.

A new Laplacian mixture conditional random field model for image labeling

Image Class Segmentation via Conditional Random Field over Weighted Histogram Classifier

Image Binarization Based on Conditional Random Fields

Hyperspectral image segmentation using spectral-spatial constrained conditional random field

CRF-Based Figure/Ground Segmentation with Pixel-Level Sparse Coding and Neighborhood Interactions.