Multicue HMM-UKF for Real-Time Contour Tracking

Yunqiang Chen,Yong Rui,Thomas S. Huang

DOI: https://doi.org/10.1109/tpami.2006.190

2006-01-01

Abstract:We propose an HMM model for contour detection based on multiple visual cues in spatial domain and improve it by joint probabilistic matching to reduce background clutter. It is further integrated with unscented Kalman filter to exploit object dynamics in nonlinear systems for robust contour tracking

What problem does this paper attempt to address?

Parametric contour tracking using unscented Kalman filter

Yunqiang Chen,Thomas S. Huang,Yong Rui

DOI: https://doi.org/10.1109/ICIP.2002.1039045

2002-01-01

Abstract:This paper presents an efficient method to integrate various spatial-temporal constraints to regularize the contour tracking. Specifically, the global shape prior, contour smoothness and object dynamics are addressed. First, the contour is represented as a parametric shape, based on which a causal smoothness constraint can be developed to exploit the local spatial constraint. The causality nature of the constraint allows us to do efficient probabilistic contour detection using the powerful hidden Markov model (HMM). Finally, a unscented Kalman filter (UKF) is applied to estimate object parameters based on the nonlinear observation model (i.e. the relationship between the detected contour points and the contour parameters) and the object dynamics. Better than other variants of the recursive least mean square estimators (e.g., extended Kalman filter), the UKF approximates nonlinear systems up to the second order (third for Gaussian prior) with similar computational cost. This novel tracking algorithm is running in real-time and robust to severe distractions due to the comprehensive spatial-temporal constraints. It is applied to track people in bad illumination and cluttered environments. Promising results are reported.
Visual Contour Tracking Based on Inner-Contour Model Particle Filter under Complex Background

Songxiao Cao,Xuanyin Wang

DOI: https://doi.org/10.1186/s13640-019-0487-7

IF: 2.399

2019-01-01

EURASIP Journal on Image and Video Processing

Abstract:In this paper, a novel particle filter–based visual contour tracking method is proposed, which uses inner-contour model to track contour object under complex background. The purpose is to achieve effectiveness and robustness against complex background. To that end, the proposed method first utilized Sobel edge detector to detect the edge information along the normal line of the contour. Then, it sampled the inner part of the normal line to get the local color information, which was then combined with the edge information to construct new normal line likelihood. After that, all the inner color information was used to construct global color likelihood. Finally, the edge information, local color information, and global color information were fused into new observation likelihood. Experimental results showed that the proposed method was robust for contours tracking under complex background, and it was also computationally efficient and can run in real-time completely.
Error Sensitive Gaussian Particle Filter and Its Evaluation for Contour Tracking

Chen Peng,Qian Hui,Wang Wei,Zhu Miaoliang

DOI: https://doi.org/10.1109/ist.2009.5071636

2009-01-01

Abstract:We present a novel system for visual based contour tracking and apply it to track the movement of human's head. Currently available technology is used in the implementation to take care of low level video processing and acquisition. The implementation consists of two main parts. First, there is an error sensitive Gaussian particle filter. It estimates the posterior density of the shape being tracked by modeling a Gaussian distribution as a collection of weighted samples. The second part is the observer which takes an estimate of the current shape position, and uses image features to find a new spline. The new spline is projected onto a subspace of Euclidean similarities of a spline template. It successfully tracks the human's head in a video stream, despite the low-resolution and low frame rate of the video.
Jpdaf Based Hmm for Real-Time Contour Tracking

YQ Chen,Y Rui,TS Huang

DOI: https://doi.org/10.1109/cvpr.2001.990521

2001-01-01

Abstract:Tracking objects using multiple cues yields more robust results. The well-known hidden Markov model (HMM) provides a powerful framework to incorporate multiple cues by expanding its observation. However, a plain HMM does not capture the inter-correlation between measurements of neighboring states when computing the transition probabilities. This can seriously damage the tracking performance. To overcome this difficulty, we propose a novel HMM framework targeted at contour-based object tracking. A joint probability data association filter (JPDAF) is used to compute the HMM's transition probabilities, taking into account the intercorrelated neighboring measurements. To ensure real-time performance, we have further developed an efficient method to calculate the data association probability via dynamic programming, which allows the proposed JPDAF-HMM to run comfortably at 30 frames/sec. This new tracking framework can easily incorporate various image cues (e.g., edge intensity, foreground region color and background region color), and also offers an online learning process to adapt to changes in the scene. To evaluate its tracking performance, we have applied the proposed JPDAF-HMM in various real-world video sequences. We report promising tracking results in complex environments.
Multi-Cue Based Tracking

Qi Wang,Jianwu Fang,Yuan Yuan

DOI: https://doi.org/10.1016/j.neucom.2013.10.021

IF: 6

2014-01-01

Neurocomputing

Abstract:Visual tracking is a central topic in computer vision. However, the accurate localization of target object in extreme conditions (such as occlusion, scaling, illumination change, and shape transformation) still remains a challenge. In this paper, we explore utilizing multi-cue information to ensure a robust tracking. Optical flow, color and depth clues are simultaneously incorporated in our framework. The optical flow can get a rough estimation of the target location. Then the part-based structure is adopted to establish the precise position, combining both color and depth statistics. In order to validate the robustness of the proposed method, we take four video sequences of different demanding situations and compare our method with five competitive ones representing state of the arts. Experiments prove the effectiveness of the proposed method. (C) 2013 Elsevier B.V. All rights reserved.
Robust Head Tracking Based on Multiple Cues Fusion in the Kernel-Bayesian Framework

Xiaoqin Zhang,Weiming Hu,Hujun Bao,Steve Maybank

DOI: https://doi.org/10.1109/tcsvt.2013.2241354

IF: 5.859

2013-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:This paper presents a robust head tracking algorithm based on multiple cues fusion in a kernel-Bayesian framework. In this algorithm, the object to be tracked is characterized using a spatial-constraint mixture of the Gaussians-based appearance model and a multichannel chamfer matching-based shape model. These two models complement each other and their combination is discriminative in distinguishing the object from the background. A selective updating technique for the appearance model is employed to accommodate appearance and illumination changes. Meantime, the kernel method-mean shift algorithm is embedded into the Bayesian framework to give a heuristic prediction in the hypotheses generation process. This alleviates the great computational load suffered by conventional Bayesian trackers. Experimental results demonstrate that the proposed algorithm is effective.
Mode-based Multi-Hypothesis Head Tracking Using Parametric Contours

Yunqiang Chen,Thomas Huang,Yong Rui

2002-01-01

Abstract:This paper describes a probabilistic mode-based multi-hypothesis tracking (MHT) algorithm. The modes are the local maximums refined from initial samples in a parametric state space. Because the modes are highly representative, this technique allows us to use a small number of hypotheses to effectively model non-linear probabilistic distributions. To ensure real-time tracking performance, we propose a novel parametric causal contour model and an efficient dynamic programming scheme to refine the initial contours to nearby modes. Furthermore, to overcome the common drawback of conventional MHT techniques, i.e., producing only the maximum likelihood estimates instead of the desired posterior, we introduce the highly effective importance sampling framework into MHT, and develop a novel procedure to estimate the posterior from the importance function. Experiments on a challenging real-world video sequence demonstrate that the proposed tracking technique is both robust in complex environment (e.g., clutter background and partial occlusion) and efficient in computation.
Detection driven adaptive multi-cue integration for multiple human tracking

Ming Yang,Fengjun Lv,Wei Xu,Yihong Gong

DOI: https://doi.org/10.1109/ICCV.2009.5459252

2009-01-01

Abstract:In video surveillance scenarios, appearances of both human and their nearby scenes may experience large variations due to scale and view angle changes, partial occlusions, or interactions of a crowd. These challenges may weaken the effectiveness of a dedicated target observation model even based on multiple cues, which demands for an agile framework to adjust target observation models dynamically to maintain their discriminative power. Towards this end, we propose a new adaptive way to integrate multi-cue in tracking multiple human driven by human detections. Given a human detection can be reliably associated with an existing trajectory, we adapt the way how to combine specifically devised models based on different cues in this tracker so as to enhance the discriminative power of the integrated observation model in its local neighborhood. This is achieved by solving a regression problem efficiently. Specifically, we employ 3 observation models for a single person tracker based on color models of part of torso regions, an elliptical head model, and bags of local features, respectively. Extensive experiments on 3 challenging surveillance datasets demonstrate long-term reliable tracking performance of this method.
Tracking Multiple Moving Objects Using Unscented Kalman Filtering Techniques

Xi Chen,Xiao Wang,Jianhua Xuan

DOI: https://doi.org/10.48550/arXiv.1802.01235

2018-02-05

Computer Vision and Pattern Recognition

Abstract:It is an important task to reliably detect and track multiple moving objects for video surveillance and monitoring. However, when occlusion occurs in nonlinear motion scenarios, many existing methods often fail to continuously track multiple moving objects of interest. In this paper we propose an effective approach for detection and tracking of multiple moving objects with occlusion. Moving targets are initially detected using a simple yet efficient block matching technique, providing rough location information for multiple object tracking. More accurate location information is then estimated for each moving object by a nonlinear tracking algorithm. Considering the ambiguity caused by the occlusion among multiple moving objects, we apply an unscented Kalman filtering (UKF) technique for reliable object detection and tracking. Different from conventional Kalman filtering (KF), which cannot achieve the optimal estimation in nonlinear tracking scenarios, UKF can be used to track both linear and nonlinear motions due to the unscented transform. Further, it estimates the velocity information for each object to assist to the object detection algorithm, effectively delineating multiple moving objects of occlusion. The experimental results demonstrate that the proposed method can correctly detect and track multiple moving objects with nonlinear motion patterns and occlusions.
A Multi-cue Fusion Algorithm for Visual Tracking of Human Motion

Ge Yang,Hong Liu

2009-01-01

Abstract:A novel multi-cue fusion algorithm is proposed for visual tracking of human motion with three common used cues: color, target position prediction and motion continuity. The algorithm adopts continuously adaptive mean shift (CAMSHIFT) technique, and is robust to partial occlusion, pose variations as well as color saturation. More specifically, in our algorithm, the color feature includes feature of hue and saturation, feature of R(red) channel, feature of G(green) channel, feature of B(blue) channel, the target position prediction is based on the frames difference, and the motion continuity is computed according to the continuity among frames. Experimental results show that our proposed multi-cue fusion algorithm is more robust than the traditional single cue based one and can achieve better tracking effect than the collaborative mean shift tracking (CMET).
Dynamic Multi-Cue Tracking Using Particle Filter

Xin Sun,Hongxun Yao,Xiusheng Lu

DOI: https://doi.org/10.1007/s11760-014-0674-z

2014-01-01

Abstract:We present a novel particle filter approach in this paper for robust object tracking using multi-cue association. In contrast to conventional particle trackers that are based on the single space, which does not provide enough information of good foreground/background discrimination, mapping the object into multiple spaces can help to seize the most informative properties of distinguishing the target from background. Moreover, the proposed algorithm commands all the spaces and their corresponding judgments in a global boosting view, which is implemented in an incremental manner to strengthen the ability of separating the target and background classes. The implicit appearance model is then used in updating step of the particle filter to measure the target region. Experimental results on several challenging video sequences have verified that the proposed method is compared very robust and effective with the traditional particle filter in many complicated scenes.
Multi-features Guided Robust Visual Tracking.

Liang Yun,Zhang Jian,Wang Mei-hua,Lin Chen,Xiao Jun

DOI: https://doi.org/10.1007/s11042-020-08791-z

IF: 2.577

2020-01-01

Multimedia Tools and Applications

Abstract:This paper focuses on dealing with the tracking challenges such as target occlusion and deformation. It proposes a new tracking method via extracting and evaluating multi-features for both target region and its adjacent surroundings. The multi-features separately describe the key factors to detect target including the color feature, the shape and contour feature, and the distributions of structure and intensity described by the Pearson Correlation Coefficient. These multi-features are proposed as the basic representation of target template and candidates and used to define a matching algorithm between them. The best matched candidate is taken as the final tracking result. To improve the efficiency of target template and candidates, the region of importance (ROI) for target is proposed by evaluating the distribution of salient values on many extended regions. The ROIs produce more accurate regions to form target template and candidates. Finally, a new template update method is defined based on the precision of tracked result to adapt to target state and achieve the follow target tracking. Using 25 videos in visual tracking benchmark, we achieve the quantitative and qualitatively evaluations of 12 different trackers. Many experiments demonstrate that our tracker produces much better results than the present trackers in dealing with target occlusion, deformation, rotation, background clutters.
Convolutional Unscented Kalman Filter for Multi-Object Tracking with Outliers

Shiqi Liu,Wenhan Cao,Chang Liu,Tianyi Zhang,Shengbo Eben Li

2024-09-15

Abstract:Multi-object tracking (MOT) is an essential technique for navigation in autonomous driving. In tracking-by-detection systems, biases, false positives, and misses, which are referred to as outliers, are inevitable due to complex traffic scenarios. Recent tracking methods are based on filtering algorithms that overlook these outliers, leading to reduced tracking accuracy or even loss of the objects trajectory. To handle this challenge, we adopt a probabilistic perspective, regarding the generation of outliers as misspecification between the actual distribution of measurement data and the nominal measurement model used for filtering. We further demonstrate that, by designing a convolutional operation, we can mitigate this misspecification. Incorporating this operation into the widely used unscented Kalman filter (UKF) in commonly adopted tracking algorithms, we derive a variant of the UKF that is robust to outliers, called the convolutional UKF (ConvUKF). We show that ConvUKF maintains the Gaussian conjugate property, thus allowing for real-time tracking. We also prove that ConvUKF has a bounded tracking error in the presence of outliers, which implies robust stability. The experimental results on the KITTI and nuScenes datasets show improved accuracy compared to representative baseline algorithms for MOT tasks.

Computer Vision and Pattern Recognition,Applications
Object contour tracking using multi-feature fusion based particle filter

Xiaofeng Lu,Li Song,Songyu Yu,Nam Ling

DOI: https://doi.org/10.1109/ICIEA.2012.6360729

2012-01-01

Abstract:In this paper, a novel object contour tracking framework integrating independent multi-feature fusion object rough location and region-based temporal differencing model is proposed. In our model, the object rough location tracking is realized by color histogram and Harris corner features fusion method in particle filter framework. Thus it can achieve more robust tracking performance in many challenge scenes. And this particle filter framework is based on our previous CamShift guided particle filter [7]. With the rough object location, efficient region-based temporal differencing model is adopted for object contour detection, then this method is faster and more effective compared to active contour models or conventional global temporal differencing models. Moreover, exact contour tracking result can be used to guide the particle propagation of next frame, to enable more efficient particle redistributions and reducing particle degeneration. Experimental results demonstrate that this proposed method is simple but effective in object location and contour tracking.
Multitarget Tracking Using Hough Forest Random Field

Jun Xiang,Nong Sang,Jianhua Hou,Rui Huang,Changxin Gao

DOI: https://doi.org/10.1109/tcsvt.2015.2489438

IF: 5.859

2016-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:This paper presents a novel tracking-by-detection approach for multitarget tracking. There are two major steps in our framework: data association to form global tracklet association, followed by trajectory estimation to deal with the remaining gaps. In the first step, we formulate tracklet association as an inference problem in a Hough forest random field, which combines Hough forest and conditional random field and allows us to model both local and global tracklet relationships in one unified model. In the second step, we improve the reversible-jump Markov chain Monte Carlo particle filtering method with explicit mutual-occlusion reasoning to fill in the remaining gaps from the first step and increase the overall tracking precision. Extensive experiments have been conducted on five public data sets, and the performance is comparable to that of the state-of-the-art method, if not better.
Robust visual tracking based on interactive multiple model particle filter by integrating multiple cues

Jianfang Dou,Jianxun Li

DOI: https://doi.org/10.1016/j.neucom.2013.12.049

IF: 6

2014-01-01

Neurocomputing

Abstract:Visual tracking can be formulated as a state estimation problem of target representation based on observations in image sequences. To investigate the integration of rough models from multiple cue and to explore computationally efficient algorithms, this paper formulates the problem of multiple cue integration and tracking to combine Interactive Multiple Model (IMM) with particle filter (IMM_PF). Interactive Multiple Model can estimate the multiple cue state of a dynamic system with several behavioral models that switch from one to another using model likelihoods and model transition probabilities. For the problem of visual tracking, the model of IMM is adopted to three target observation models: Corrected Background Weighted Histogram (CBWH), Completed Local Ternary Patterns (CLTP) and Histogram of Oriented Gradients (HOG). The probabilities of these models are corresponding to the weights of multiple cues. IMM_PF then dynamically adjusts the weights of different features. Compared with those state-of-the-art methods in the tracking literature, this algorithm can track the object accurately in conditions of rotation, abrupt shifts, as well as clutter and partial occlusions occurring to the tracking object with good robustness, as demonstrated by experimental results.
Region Tracking via HMMF in Joint Feature-Spatial Space

Xiaotong Yuan,ShuTang Yang,HongWen Zhu

DOI: https://doi.org/10.1109/ACVMOT.2005.100

2007-01-01

Abstract:Region-based tracking in a temporal image sequence is described as a segmentation of current frame into a set of non-overlapping regions: the tracking regions and the non-tracking region. The segmentation is viewed to be a Markov labeling process. Based on the key idea of using a doubly stochastic prior model, the optimal estimation for the label field is found by the minimization of a differentiable function. We exploit the feature-spatial probabilistic representation of a region as the conditional distribution in the Bayesian framework, which makes our tracker robust to local deformation and partial occlusion. The continuity of the objective function leads to a much faster numerical implementation. Very promising experimental results on some real-world sequences are presented to illustrate the performance of the presented algorithm.
Dynamic Multi-Cue Tracking with Detection Responses Association.

Guochen Jia,Yonghong Tian,Yaowei Wang,Tiejun Huang,Min Wang

DOI: https://doi.org/10.1145/1873951.1874179

2010-01-01

Abstract:Multi-cue integration has proved successful at increasing the robustness of tracking algorithms and overcoming the failure cases of individual cue. But considering dynamic appearance of objects or clutter background, the integration based on constant weights may weaken the performance of this scheme. In this paper, we propose a dynamic weights update mechanism for multiple cues tracking with detection responses as supervision. We integrate multiple cues based on the observation hypotheses compared with detection association results and adjust the weights according to the approximation degree. The integration is adapted on-the-fly during tracking, in order to keep the tracker adaptive. The proposed method allows flexible combination of different cues and we select cues based on color and local feature for tracking. Experiments are carried out on 602 trajectories extracted from TRECVID 2008 event detection dataset which is recorded in an airport scenario. Comparison results prove the effectiveness of our method.
A Dynamic Bayesian Network Approach to Multi-Cue Based Visual Tracking

T Wang,Q Diao,YM Zhang,G Song,CR Lai,G Bradski

DOI: https://doi.org/10.1109/icpr.2004.1334087

2004-01-01

Abstract:Visual tracking has been an active research field of computer vision. However, robust tracking is still far from satisfactory under conditions of various background clutter, poses and occlusion in the real world. To increase reliability, This work presents a novel dynamic Bayesian networks (DBNs) approach to multi-cue based visual tracking. The method first extracts multi-cue observations such as skin color, ellipse shape, face detection, and then integrates them with hidden motion states in a compact DBN model. By using particle-based inference with multiple cues, our method works well even in background clutter without the need to resort to simplified linear and Gaussian assumptions. The experimental results are compared against the widely used condensation and KF approaches. Our better tracking results along with ease of fusing new cues in the DBN framework suggest that this technique is a fruitful basis to build top performing visual tracking systems.

Multicue HMM-UKF for Real-Time Contour Tracking

Parametric contour tracking using unscented Kalman filter

Visual Contour Tracking Based on Inner-Contour Model Particle Filter under Complex Background

Error Sensitive Gaussian Particle Filter and Its Evaluation for Contour Tracking

Jpdaf Based Hmm for Real-Time Contour Tracking

Multi-Cue Based Tracking

Robust Head Tracking Based on Multiple Cues Fusion in the Kernel-Bayesian Framework

Mode-based Multi-Hypothesis Head Tracking Using Parametric Contours

Detection driven adaptive multi-cue integration for multiple human tracking

Tracking Multiple Moving Objects Using Unscented Kalman Filtering Techniques

A Multi-cue Fusion Algorithm for Visual Tracking of Human Motion

Dynamic Multi-Cue Tracking Using Particle Filter

Multi-features Guided Robust Visual Tracking.

Convolutional Unscented Kalman Filter for Multi-Object Tracking with Outliers

Object contour tracking using multi-feature fusion based particle filter

Multitarget Tracking Using Hough Forest Random Field

Robust visual tracking based on interactive multiple model particle filter by integrating multiple cues

Region Tracking via HMMF in Joint Feature-Spatial Space

Dynamic Multi-Cue Tracking with Detection Responses Association.

A Dynamic Bayesian Network Approach to Multi-Cue Based Visual Tracking