Abstract:This paper proposes an automatic image co-segmentation algorithm based on deep reinforcement learning (RL). Existing co-segmentation tasks mainly rely on deep learning methods, and the obtained foreground edges are often rough. In order to obtain more precise foreground edges, we use deep RL to solve this problem and achieve the finer segmentation. To our best knowledge, this is the first work to apply RL methods to co-segmentation. We define the problem as a Markov Decision Process (MDP) and optimize it by RL with asynchronous advantage actor-critic (A3C). The RL image co-segmentation network uses the correlation between images to segment common and salient objects from a set of related images. In order to achieve automatic segmentation, our RL-CoSeg method eliminates user's hints. For the image co-segmentation problem, we propose a collaborative RL algorithm based on the A3C model. We propose a Siamese RL co-segmentation network structure to obtain the co-attention of images for co-segmentation. We improve the self-attention for automatic RL algorithm to obtain long-distance dependence and enlarge the receptive field. The image feature information obtained by self-attention can be used to supplement the deleted user's hints and help to obtain more accurate actions. Experimental results have shown that our method can improve the performance effectively on both coarse and fine initial segmentations, and it achieves the state-of-the-art performance on Internet dataset, iCoseg dataset and MLMR-COS dataset.

Multiple Kernel Boosting Based Two-Level Rgbd Image Co-Segmentation

Unsupervised Salient Object Segmentation Based on Kernel Density Estimation and Two-Phase Graph Cut

Object Co-Segmentation Via Discriminative Low Rank Matrix Recovery.

Rgb-D Object Recognition Using The Knowledge Transferred From Relevant Rgb Images

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

RGBD Image Co-saliency Object Detection Based on Sample Selection

RL-CoSeg : A Novel Image Co-Segmentation Algorithm with Deep Reinforcement Learning

RGB-D Image Semantic Segmentation Based on Multi-Modal Adaptive Convolution

Depth-Aware Salient Object Detection and Segmentation Via Multiscale Discriminative Saliency Fusion and Bootstrap Learning

Object Co-Segmentation Via Salient and Common Regions Discovery

RGB-D Image Instance Segmentation Based On Seeded Region Growing Algorithm

Object Segmentation Ensuring Consistency Across Multi-Viewpoint Images

Object Segmentation Using Low-Rank Representation with Multiple Block-Diagonal Priors

RGB-D Individual Segmentation

Multi Kernel Estimation based Object Segmentation

Multi-color Space Learning for Image Segmentation Based on a Support Vector Machine

Multilevel Cross-Aware RGBD Indoor Semantic Segmentation for Bionic Binocular Robot

A Novel Multiple Kernel Boosting Method For Hyperspectral Image Classification

A multi-object segmentation algorithm based on background modeling and region growing

Co-Saliency Detection for RGBD Images Based on Multi-Constraint Feature Matching and Cross Label Propagation

Toward Stable Co-Saliency Detection and Object Co-Segmentation