Abstract:While supervised learning approaches show great vitality and effectiveness in video object segmentation, most of them require large amounts of annotations which are expensive and time-consuming. Recently, self-supervised learning has attracted great attention by benefiting from unlabeled video sequences. However, current patch-based self-supervised video object segmentation methods only discriminate the patch from the entire image without distinguishing the object of interest from meaningless backgrounds or even occlusion. These disturbances deteriorate the extracted features and hinder the robustness of tracking when applied to real-world video sequences. In this paper, we propose a novel model named Tracker With Integration-Augmented Attention (TWIAA) to achieve both label-free and prominent performance. Specifically, we integrate both spatial and channel dimensions by introducing a feature spatial enhancement module and a two-stream channel module. With the combination of the two modules, the network can focus on exploring the discriminative object and suppressing the irrelevant part to improve the tracking robustness. Moreover, unlike other methods that calculate features separately on the search branch and template branch, the two designed modules coupled with the Siamese network compute the respective features of the search branch and the template branch jointly to augment the interdependence of the two branches. Such interdependence is injected into both spatial and channel dimensions. So that our approach establishes richer and more discriminative associations to identify the object more accurately. In addition, our method takes full advantage of cycle-consistency information in consecutive frames, which uses coherence as the learning signal to acquire object-oriented relationships. Extensive experiments and ablation studies are conducted on large VOS benchmarks, including DAVIS-2017, YouTube-VOS-2018, and YouTube-VOS-2019. The results verify that our proposed framework has both strong feature representation and competitive performance compared with supervised and self-supervised models.

WatershedObject Tracking Based on Static Segmentation and Motion Vector

Motionobject segmentation algorithm based on spatial-temporal information

Fast compressive tracking algorithm based on motion vector and assigning weight value

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Pixel Feature-Weighted Scale-Adaptive Object Tracking Algorithm

Image Segmentation Based on Watershed Transform

A New Detection and Tracking Algorithm for Moving Objects

An algorithm for automatic segmentation of video objects based on intra-frame image partition

IMAGE SEGMENTATION: A WATERSHED TRANSFORMATION ALGORITHM

Motion Objects Segmentation Using a New Level Set Based Method

Video object segmentation by tracking regions

Unsupervised Segmentation of Moving Object by Region-Based MRF Model and Occlusion Detection

An automatic segmentation algorithm for moving objects in video sequences under multi-constraints

An Occlusion Tolerent Method For Multi-Object Tracking

Tracking Randomly Moving Objects on Edge Box Proposals

A Novel Video Object Tracking Approach Based on Kernel Density Estimation and Markov Random Field

Self-supervised Video Object Segmentation Using Integration-Augmented Attention

Moving Object Segmentation Based on Wavelet Transform and ICA

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

Fish Tracking and Segmentation From Stereo Videos on the Wild Sea Surface for Electronic Monitoring of Rail Fishing

Accurate Moving Object Segmentation by a Hierarchical Region Labeling Approach