Abstract:This paper tackles the task of online video object segmentation with weak supervision, i.e., labeling the target object and background with pixel-level accuracy in unconstrained videos, given only one bounding box information in the first frame. We present a novel tracking-assisted visual object segmentation framework to achieve this. On the one hand, initialized with a given bounding box in the first frame, the auxiliary object tracking module guides the segmentation module frame by frame by providing motion and region information, which is usually missing in semi-supervised methods. Moreover, compared with the unsupervised approach, our approach with such minimum supervision can focus on the target object without bringing unrelated objects into the final results. On the other hand, the video object segmentation module also improves the robustness of the visual object tracking module by pixel-level localization and objectness information. Thus, segmentation and tracking in our framework can mutually help each other in an online manner. To verify the generality and effectiveness of the proposed framework, we evaluate our weakly supervised method on two cross-domain datasets, i.e., the DAVIS and VOT2016 datasets, with the same configuration and parameter setting. Experimental results show the top performance of our method, which is even better than the leading semi-supervised methods. Furthermore, we conduct the extensive ablation study on our approach to investigate the influence of each component and main parameters.

Weak Supervision Learning for Object Co-Segmentation

Robust Object Co-Segmentation Using Background Prior.

Show, Match and Segment: Joint Weakly Supervised Learning of Semantic Matching and Object Co-Segmentation

Object Co-Segmentation Via Weakly Supervised Data Fusion

Weakly Supervised Object Detection with Segmentation Collaboration

Boat in the Sky: Background Decoupling and Object-aware Pooling for Weakly Supervised Semantic Segmentation

A Probabilistic Associative Model For Segmenting Weakly Supervised Images

Separate and Conquer: Decoupling Co-occurrence via Decomposition and Representation for Weakly Supervised Semantic Segmentation

Mixed-dual-head Meets Box Priors: A Robust Framework for Semi-supervised Segmentation

Multi-class Object Segmentation Based on Jointly Integrating Segment-Level and Image-Level Object Priors

Video Object Discovery and Co-segmentation with Extremely Weak Supervision.

Tracking-assisted Weakly Supervised Online Visual Object Segmentation in Unconstrained Videos

A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Prediction

Object Co-Segmentation Via Salient and Common Regions Discovery

Weakly Supervised Semantic Segmentation Based on Co-segmentation.

Object Co-Segmentation Via Discriminative Low Rank Matrix Recovery.

Toward Stable Co-Saliency Detection and Object Co-Segmentation

Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features.

Weakly Supervised Learning of Instance Segmentation with Confidence Feedback.

Mining Pixels: Weakly Supervised Semantic Segmentation Using Image Labels