Abstract:Combining Convolutional Neural Networks (CNNs) with Conditional Random Fields (CRFs) achieves great success among recent object segmentation methods. There are two advantages by such usage. First, CNNs can extract low-level features, which are very similar to the extracted features in primates’ primary visual cortex (V1). Second, CRFs can set up the relationship between input features and output labels in a direct way. In this paper, we extend the first advantage by using CNNs for low-level feature extraction and a Structured Random Forest (SRF)-based border ownership detector for high-level feature extraction, which are similar to the outputs of primates secondary visual cortex (V2). Compared to the CRF model, an improved Conditional Boltzmann Machine (CBM), which has a multi-channel visible layer, is proposed to model the relationship between predicted labels, local and global contexts of objects with multi-scale and multilevel features. Besides, our proposed CBM model is extended for object parsing by using multivisible branches instead of a single visible layer of CBM, which cannot only segment the whole body but also the parts of the body under. These visible branches use each branch for the segmentation of the whole body or one of the body parts. All branches share the same hidden layers of CBM and train the branches under an iterative way. By exploiting object parsing, the whole body segmentation performance of object is improved. To refine the segmentation output, two kinds of optimization algorithms are proposed. The superpixel-based algorithm can re-label the overlapped regions of multiple kinds of objects. The other curve correction algorithm corrects the edges of segmented object parts by using smooth edges under a curve similarity criterion. Experiments demonstrate that our models yield competitive results for object segmentation on the PASCAL VOC 2012 dataset and for object parsing on the PennFudan Pedestrian Parsing dataset, Pedestrian Parsing Surveillance Scenes dataset, Horse-Cow parsing dataset, and PASCAL Quadrupeds dataset.

RL-CoSeg : A Novel Image Co-Segmentation Algorithm with Deep Reinforcement Learning

RLSegNet: An Medical Image Segmentation Network Based on Reinforcement Learning

Object Co-Segmentation Via Discriminative Low Rank Matrix Recovery.

CycleSegNet: Object Co-segmentation with Cycle Refinement and Region Correspondence

Reinforcement Learning for Context Aware Segmentation.

Toward Stable Co-Saliency Detection and Object Co-Segmentation

A General Framework for Context-Specific Image Segmentation Using Reinforcement Learning

SegMind: Semisupervised Remote Sensing Image Semantic Segmentation With Masked Image Modeling and Contrastive Learning Method

RCI-Seg: Robust Click-Based Interactive Segmentation Framework with Deep Reinforcement Learning for Biomedical Images

DCSegNet: Deep Learning Framework Based on Divide-and-Conquer Method for Liver Segmentation

Group-wise Deep Object Co-Segmentation with Co-Attention Recurrent Neural Network

Object Co-Segmentation Via Salient and Common Regions Discovery

Learning Deep Conditional Neural Network for Image Segmentation

Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learning

Multi-step Segmentation for Prostate MR Image Based on Reinforcement Learning

Deep Generative Adversarial Reinforcement Learning for Semi-Supervised Segmentation of Low-Contrast and Small Objects in Medical Images

MRL-Seg: Overcoming Imbalance in Medical Image Segmentation With Multi-Step Reinforcement Learning

Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning

A Novel Co-Attention Computation Block for Deep Learning Based Image Co-Segmentation

A Dense Siamese U-Net Trained with Edge Enhanced 3D IOU Loss for Image Co-segmentation

Multiple Kernel Boosting Based Two-Level Rgbd Image Co-Segmentation