Abstract:Combining Convolutional Neural Networks (CNNs) with Conditional Random Fields (CRFs) achieves great success among recent object segmentation methods. There are two advantages by such usage. First, CNNs can extract low-level features, which are very similar to the extracted features in primates’ primary visual cortex (V1). Second, CRFs can set up the relationship between input features and output labels in a direct way. In this paper, we extend the first advantage by using CNNs for low-level feature extraction and a Structured Random Forest (SRF)-based border ownership detector for high-level feature extraction, which are similar to the outputs of primates secondary visual cortex (V2). Compared to the CRF model, an improved Conditional Boltzmann Machine (CBM), which has a multi-channel visible layer, is proposed to model the relationship between predicted labels, local and global contexts of objects with multi-scale and multilevel features. Besides, our proposed CBM model is extended for object parsing by using multivisible branches instead of a single visible layer of CBM, which cannot only segment the whole body but also the parts of the body under. These visible branches use each branch for the segmentation of the whole body or one of the body parts. All branches share the same hidden layers of CBM and train the branches under an iterative way. By exploiting object parsing, the whole body segmentation performance of object is improved. To refine the segmentation output, two kinds of optimization algorithms are proposed. The superpixel-based algorithm can re-label the overlapped regions of multiple kinds of objects. The other curve correction algorithm corrects the edges of segmented object parts by using smooth edges under a curve similarity criterion. Experiments demonstrate that our models yield competitive results for object segmentation on the PASCAL VOC 2012 dataset and for object parsing on the PennFudan Pedestrian Parsing dataset, Pedestrian Parsing Surveillance Scenes dataset, Horse-Cow parsing dataset, and PASCAL Quadrupeds dataset.

Fully Automatic Figure-Ground Segmentation Algorithm Based on Deep Convolutional Neural Network and GrabCut

Automatic foreground extraction of head shoulder images

Human object segmentation using Gaussian mixture model and graph cuts

Attention-Guided Multi-Scale Segmentation Neural Network For Interactive Extraction Of Region Objects From High-Resolution Satellite Imagery

Research on Improved Image Segmentation Algorithm Based on GrabCut

An H-GrabCut Image Segmentation Algorithm for Indoor Pedestrian Background Removal

Automatic Segmentation of Foreground Objects from Multiple Images Based on Consistency Analysis

Automatic foreground segmentation using light field images

A Universal Foreground Segmentation Technique using Deep-Neural Network

Adaptive figure-ground classification

E-GrabCut: an Economic Method of Iterative Video Object Extraction

Example-Driven Semi-automatic Image Collection Segmentation

Human Segmentation Based on Disparity Map and GrabCut

S Seg: A Three-Stage Unsupervised Foreground and Background Segmentation Network

Deep Features Homography Transformation Fusion Network-A Universal Foreground Segmentation Algorithm for PTZ Cameras and a Comparative Study

MIDeepSeg: Minimally interactive segmentation of unseen objects from medical images using deep learning

A Practical GrabCut Color Image Segmentation Based on Bayes Classification and Simple Linear Iterative Clustering.

Learning Deep Conditional Neural Network for Image Segmentation

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs

Automatic Segmentation of Head-and-Shoulder Images by Combining Edge Feature and Shape Prior

Accurate face segmentation based on fusion of improved GrabCut and ASM