Abstract:Traditionally, object tracking and segmentation are treated as two separate problems and solved independently. However, in this paper, we argue that tracking and segmentation are actually closely related and solving one should help the other. On one hand, the object track, which is a set of bounding boxes with one bounding box in every frame, would provide strong high-level guidance for the target/background segmentation task. On the other hand, the object segmentation would separate object from other objects and background, which will be useful for determining track locations in every frame. We propose a novel framework which combines online multiple target tracking and segmentation in a video. In our approach, the tracking and segmentation problems are coupled by Lagrange dual decomposition, which leads to more accurate segmentation results and also \emph{helps resolve typical difficulties in multiple target tracking, such as occlusion handling, ID-switch and track drifting}. To track targets, an individual appearance model is learned for each target via structured learning and network flow is employed to generate tracks from densely sampled candidates. For segmentation, multi-label Conditional Random Field (CRF) is applied to a superpixel based spatio-temporal graph in a segment of video to assign background or target labels to every superpixel. The experiments on diverse sequences show that our method outperforms state-of-the-art approaches for multiple target tracking as well as segmentation.

Primal-dual method for spatiotemporal tracking model with moving background

Motionobject segmentation algorithm based on spatial-temporal information

Convex Relaxation for a 3D Spatiotemporal Segmentation Model Using the Primal-Dual Method

Tracking human under occlusion based on kernel density estimation

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Moving Object Tracking Research Based on Active Vision

Visual Contour Tracking Based on Inner-Contour Model Particle Filter under Complex Background

Visual Tracking Via Subspace Motion Model

A Spatiotemporal Multiple Moving Objects Segmentation and Tracking with Level Set

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

Video Object Contour Tracking Using Improved Dual-Front Active Contour

Moving target tracking using sparse optical flow method

On Duality Of Multiple Target Tracking and Segmentation

Spatiotemporal Strategies for Joint Segmentation and Motion Tracking from Cardiac Image Sequences

Multiple-Target Tracking by Spatiotemporal Monte Carlo Markov Chain Data Association

Motion Targets Tracking Algorithm Based on Video Surveillance

Real-time moving target tracking based on dynamically switching models

Motion Segmentation Model Based on Total Variation and Split Bregman Algorithm

Visual Tracking Via Subspace Learning: A Discriminative Approach.

Object Tracking Using Spatio-Temporal Future Prediction