Abstract:Semantic segmentation has achieved huge progress via adopting deep Fully Convolutional Networks (FCN). However, the performance of FCN-based models severely rely on the amounts of pixel-level annotations which are expensive and time-consuming. Considering that bounding boxes also contain abundant semantic and objective information, an intuitive solution is to learn the segmentation with weak supervisions from the bounding boxes. How to make full use of the class-level and region-level supervisions from bounding boxes to estimate the uncertain regions is the critical challenge for the weakly supervised learning task. In this paper, we propose a mixture model to address this problem. First, we introduce a box-driven class-wise masking model (BCM) to remove irrelevant regions of each class. Moreover, based on the pixel-level segment proposal generated from the bounding box supervision, we calculate the mean filling rates of each class to serve as an important prior cue to guide the model ignoring the wrongly labeled pixels in proposals. To realize the more fine-grained supervision at instance-level, we further propose the anchor-based filling rate shifting module. Unlike previous methods that directly train models with the generated noisy proposals, our method can adjust the model learning dynamically with the adaptive segmentation loss. Thus it can help reduce the negative impacts from wrongly labeled proposals. Besides, based on the learned high-quality proposals with above pipeline, we explore to further boost the performance through two-stage learning. The proposed method is evaluated on the challenging PASCAL VOC 2012 benchmark and achieves 74.9 % and 76.4 % mean IoU accuracy under weakly and semi-supervised modes, respectively. Extensive experimental results show that the proposed method is effective and is on par with, or even better than current state-of-the-art methods.

Improving The Discrimination Between Foreground And Background For Semantic Segmentation

Research of improving semantic image segmentation based on a feature fusion model

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Unsupervised segmentation via semantic-apparent feature fusion

Discriminative Features Reconstruction Network For Semantic Segmentation

Image semantic segmentation based on improved DeepLabv3+ network and superpixel edge optimization

Improved segmentation under extreme imbalance towards full background images

Box-driven Class-wise Region Masking and Filling Rate Guided Loss for Weakly Supervised Semantic Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Foreground Detection in Surveillance Video with Fully Convolutional Semantic Network

Better Image Segmentation by Exploiting Dense Semantic Predictions

Bias-Correction Feature Learner for Semi-Supervised Instance Segmentation

Background Adaptation with Residual Modeling for Exemplar-Free Class-Incremental Semantic Segmentation

Semantic Segmentation via Highly Fused Convolutional Network with Multiple Soft Cost Functions

Foreground Detection Based on Superpixel and Semantic Segmentation

Tackling background ambiguities in multi-class few-shot point cloud semantic segmentation

Learning Complementary Saliency Priors for Foreground Object Segmentation in Complex Scenes

Weakly Supervised Semantic Segmentation via Box-Driven Masking and Filling Rate Shifting

High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks

Built-in Foreground/Background Prior for Weakly-Supervised Semantic Segmentation

Semisupervised Semantic Segmentation by Improving Prediction Confidence