Abstract:Weakly supervised semantic segmentation (WSSS) mainly adopts class activation map (CAM) to recognize different categories with generated pseudo masks of only image-level labels. Recently, many advanced works focus on learning the semantic correlation to refine the conventional CAM, which only identify sparse and discriminative semantic regions, severely weakening the further learning ability of spatial features. To copy with the above problem, a spatial correlation-guided learning framework is proposed to exploit the spatial and semantic correlation between adjacent pixels for weakly supervised fine-grained semantic segmentation (WSFGSS). From the spatial perspective, self-supervised multi-view clustering (SMC) is designed to fully mine spatial correlation by clustering of multiple views including scale, angle and position. Moreover, a hybrid self-supervised (HS) loss function is used to further promote the optimized speed and accuracy of three spatial representations. From the semantic perspective, the affinity matrix is applied to describe the semantic similarity between different pixels by building a weighted graph, and combine above robust pseudo label into a probability transition matrix. Therefore, the initial CAM is gradually corrected during the iterative optimization by the random walk algorithm. Finally, the refined CAM is utilized as supervision information for training the standard segmentation network effectively. Sufficient experimental results on BSDS500, PASCAL VOC 2012 and MS COCO datasets show that the proposed SMC method obtains more accurate pseudo labels than the recent unsupervised segmentation models. Meantime, with these pseudo labels, the proposed fine-grained framework achieves the state-of-the-art performance for WSFGSS.

Object co-segmentation via weakly supervised data fusion

Object Co-Segmentation Via Weakly Supervised Data Fusion

Weak Supervision Learning for Object Co-Segmentation

Object Co-Segmentation Via Salient and Common Regions Discovery

Extensible Image Object Co-Segmentation with Sparse Cooperative Relations

Coarse-to-fine Image Co-segmentation with Intra and Inter Rank Constraints

Human Centred Object Co-Segmentation

Image Co-Segmentation Via Saliency Co-Fusion

Show, Match and Segment: Joint Weakly Supervised Learning of Semantic Matching and Object Co-Segmentation

Robust Object Co-Segmentation Using Background Prior.

Image Co-segmentation Via Multi-scale Local Shape Transfer

Weakly Supervised Semantic Segmentation by Multiple Group Cosegmentation

Channel and spatial attention based deep object co-segmentation

Scalable Image Co-Segmentation Using Color and Covariance Features

Robust Video Object Cosegmentation.

Object Cosegmentation by Similarity Propagation with Saliency Information and Objectness Frequency Map

Using visual segments and spatial layouts for unsupervised object co-segmentation

Object Co-skeletonization with Co-segmentation

Weakly Supervised Fine-Grained Semantic Segmentation Via Spatial Correlation-Guided Learning

Deep Object Co-segmentation via Spatial-Semantic Network Modulation

Multi-class Cosegmentation with Pairwise Active Learning.