Abstract:Combining Convolutional Neural Networks (CNNs) with Conditional Random Fields (CRFs) achieves great success among recent object segmentation methods. There are two advantages by such usage. First, CNNs can extract low-level features, which are very similar to the extracted features in primates’ primary visual cortex (V1). Second, CRFs can set up the relationship between input features and output labels in a direct way. In this paper, we extend the first advantage by using CNNs for low-level feature extraction and a Structured Random Forest (SRF)-based border ownership detector for high-level feature extraction, which are similar to the outputs of primates secondary visual cortex (V2). Compared to the CRF model, an improved Conditional Boltzmann Machine (CBM), which has a multi-channel visible layer, is proposed to model the relationship between predicted labels, local and global contexts of objects with multi-scale and multilevel features. Besides, our proposed CBM model is extended for object parsing by using multivisible branches instead of a single visible layer of CBM, which cannot only segment the whole body but also the parts of the body under. These visible branches use each branch for the segmentation of the whole body or one of the body parts. All branches share the same hidden layers of CBM and train the branches under an iterative way. By exploiting object parsing, the whole body segmentation performance of object is improved. To refine the segmentation output, two kinds of optimization algorithms are proposed. The superpixel-based algorithm can re-label the overlapped regions of multiple kinds of objects. The other curve correction algorithm corrects the edges of segmented object parts by using smooth edges under a curve similarity criterion. Experiments demonstrate that our models yield competitive results for object segmentation on the PASCAL VOC 2012 dataset and for object parsing on the PennFudan Pedestrian Parsing dataset, Pedestrian Parsing Surveillance Scenes dataset, Horse-Cow parsing dataset, and PASCAL Quadrupeds dataset.

Constraint Satisfaction Solution for Target Segmentation under Complex Background

Attention-Guided Network with Densely Connected Convolution for Skin Lesion Segmentation

Coarse-to-fine Image Co-segmentation with Intra and Inter Rank Constraints

An Image Segmentation Approach Based on Fuzzy-Neural-network Hybrid System

Learning Deep Conditional Neural Network for Image Segmentation

Deep Conditional Neural Network for Image Segmentation

HCS-TNAS: Hybrid Constraint-driven Semi-supervised Transformer-NAS for Ultrasound Image Segmentation

Learning Cross-Channel Representations for Semantic Segmentation

Unbalanced Class Learning Network With Scale-Adaptive Perception for Complicated Scene in Remote Sensing Images Segmentation

CI-Net: a joint depth estimation and semantic segmentation network using contextual information

CSC-Unet: A Novel Convolutional Sparse Coding Strategy Based Neural Network for Semantic Segmentation

Automatic Image Segmentation Based on PCNN with Adaptive Threshold Time Constant.

Learning Complementary Saliency Priors for Foreground Object Segmentation in Complex Scenes

Scale-Aware Neural Network for Semantic Segmentation of Multi-Resolution Remote Sensing Images

High-Precision Dichotomous Image Segmentation With Frequency and Scale Awareness

MFCP-Net: Multiscale Feature Correlation Perception Network for Image Segmentation Based on Background Prior

Multiclass Image Segmentation Based on Pixel and Segment Level

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

CPISNet: Delving into Consistent Proposals of Instance Segmentation Network for High-Resolution Aerial Images

Real-Time Image Segmentation via Hybrid Convolutional-Transformer Architecture Search

Anatomy-Constrained Contrastive Learning for Synthetic Segmentation without Ground-truth