Object tracking with adaptive multicue incremental visual tracker

WangJiang-tao,ChenDe-bao,ZhangJing-ai,LiSu-wen,WangXing-jun

2014-01-01

Advances in Multimedia

Abstract:Generally, subspace learning based methods such as the Incremental Visual Tracker (IVT) have been shown to be quite effective for visual tracking problem. However, it may fail to follow the target ...

What problem does this paper attempt to address?

Weighted Incremental Subspace Learning Algorithm Suitable for Object Tracking

QIAN Cheng,ZHANG San-yuan

DOI: https://doi.org/10.3785/j.issn.1008-973x.2011.12.026

2011-01-01

Abstract:An object tracking method based on weighted incremental subspace learning was proposed to overcome the difficulty in object tracking resulting from variations in appearance.The method constructs a subspace updated online to depict the appearance of the object in the video.A set of image patches are predicted based on probabilistic transformation model as candidate image regions of the object in the current frame,then these image patches are projected onto the low-dimensional subspace,and the likelihood of each image patch as the image region of the object is evaluated.The image patch with maximal likelihood is regarded as the object image region.Finally,the subspace is updated incrementally with temporal weights.Experimental results show that the method accomplishes object tracking more steadily and accurately,compared with other incremental subspace learning based object tracking methods.
Robust visual tracking via weighted incremental subspace learning

Cheng Qian,ShuChang Xu,Sanyuan Zhang

DOI: https://doi.org/10.1109/ICFCC.2010.5497295

2010-01-01

Abstract:A method is proposed for tracking objects in face with varying viewpoints and partial occlusions. A low-dimensional subspace is built to model the appearance of the target. And each image sample is presented as a coefficient vector in the subspace. A collection of image patches are sampled as the candidates of the object image region in the current frame, and their likelihoods of being the object are evaluated resorting to the reconstructions from the corresponding coefficient vectors. The image patch with highest likelihood is selected as the object image region. Finally, the subspace is incrementally updated based on the coefficient vectors, which are assigned with the temporal weights to enhance the adaptability of the tracker. Experimental results show that our proposed method can locate the target accurately even when the target undergoes changes in viewpoints and partial occlusions.
Object Tracking Method Based on Incrementally Updating Linear Discriminant Subspace

钱诚,徐舒畅,张引,张三元

DOI: https://doi.org/10.3969/j.issn.1003-6059.2010.02.018

2010-01-01

Pattern Recognition and Artificial Intelligence

Abstract:A method for object tracking is presented to track objects steadily based on incremental linear discriminant analysis.The locations and poses of the object are represented by a set of affine parameters.Resorting to a state transition model,a group of image samples are predicted as candidates of the image patches of the object in the next frame.Their likelihoods of being the object image patch are measured after they are projected into a linear discriminant subspace.Then a sample with maximum likelihood is regarded as the object image patch.Finally,sufficient spanning sets of total scatter matrix and between-class scatter matrix are rotated to update projection matrix for maintaining the discrimination power of the subspace.Experimental results show that the method is robust to variation in appearances of objects and surrounding background,and it is available in affine invariant tracking.
Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Jongwon Ra,MengMeng Wang,Jianbiao Mei,Shanqi Liu,Yu Yang,Yong Liu

DOI: https://doi.org/10.1109/3dv62453.2024.00050

2024-01-01

Abstract:The point cloud-based 3D single object tracking plays an indispensable role in autonomous driving. However, the application of 3D object tracking in the real world is still challenging due to the inherent sparsity and self-occlusion of point cloud data. Therefore, it is necessary to exploit as much useful information from limited data as we can. Since 3D object tracking is a video-level task, the appearance of objects changes gradually over time, and there is rich spatiotemporal contextual information among historical frames. However, existing methods do not fully utilize this information. To address this, we propose a new method called SCTrack, which utilizes a memory-based paradigm to exploit spatiotemporal contextual information. SCTrack incorporates both long-term and short-term memory banks to store the spatiotemporal features of targets from historical frames. By doing so, the tracker can benefit from the entire video sequence and make more informed predictions. Additionally, SCTrack extracts the mask prior to augmenting the target representation, improving the target-background discriminability. Extensive experiments on KITTI, nuScenes, and Waymo Open datasets verify the effectiveness of our proposed method.
Multi-features Guided Robust Visual Tracking.

Liang Yun,Zhang Jian,Wang Mei-hua,Lin Chen,Xiao Jun

DOI: https://doi.org/10.1007/s11042-020-08791-z

IF: 2.577

2020-01-01

Multimedia Tools and Applications

Abstract:This paper focuses on dealing with the tracking challenges such as target occlusion and deformation. It proposes a new tracking method via extracting and evaluating multi-features for both target region and its adjacent surroundings. The multi-features separately describe the key factors to detect target including the color feature, the shape and contour feature, and the distributions of structure and intensity described by the Pearson Correlation Coefficient. These multi-features are proposed as the basic representation of target template and candidates and used to define a matching algorithm between them. The best matched candidate is taken as the final tracking result. To improve the efficiency of target template and candidates, the region of importance (ROI) for target is proposed by evaluating the distribution of salient values on many extended regions. The ROIs produce more accurate regions to form target template and candidates. Finally, a new template update method is defined based on the precision of tracked result to adapt to target state and achieve the follow target tracking. Using 25 videos in visual tracking benchmark, we achieve the quantitative and qualitatively evaluations of 12 different trackers. Many experiments demonstrate that our tracker produces much better results than the present trackers in dealing with target occlusion, deformation, rotation, background clutters.
MATI: Multimodal Adaptive Tracking Integrator for Robust Visual Object Tracking

Kai Li,Lihua Cai,Guangjian He,Xun Gong

DOI: https://doi.org/10.3390/s24154911

2024-07-29

Abstract:Visual object tracking, pivotal for applications like earth observation and environmental monitoring, encounters challenges under adverse conditions such as low light and complex backgrounds. Traditional tracking technologies often falter, especially when tracking dynamic objects like aircraft amidst rapid movements and environmental disturbances. This study introduces an innovative adaptive multimodal image object-tracking model that harnesses the capabilities of multispectral image sensors, combining infrared and visible light imagery to significantly enhance tracking accuracy and robustness. By employing the advanced vision transformer architecture and integrating token spatial filtering (TSF) and crossmodal compensation (CMC), our model dynamically adjusts to diverse tracking scenarios. Comprehensive experiments conducted on a private dataset and various public datasets demonstrate the model's superior performance under extreme conditions, affirming its adaptability to rapid environmental changes and sensor limitations. This research not only advances visual tracking technology but also offers extensive insights into multisource image fusion and adaptive tracking strategies, establishing a robust foundation for future enhancements in sensor-based tracking systems.
Visual Object Tracking Via Guessing and Matching

Ke Song,Wei Zhang,Weizhi Lu,Zheng-Jun Zha,Xiangyang Ji,Yibin Li

DOI: https://doi.org/10.1109/tcsvt.2019.2948600

IF: 5.859

2020-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Visual object tracking is a fundamental and time-critical vision task. However, most trackers such as SiamFC and CFNet missed the object movement and simply defined the searching region centered at the location of the target in the previous frame. So they tend to fail in the cases with severe occlusion or a large displacement of the target. In this paper, we consider the object tracking as a dual-task problem of guessing and matching. A guess module is to estimate the motion trend of the target by reinforcement learning based on the observations on appearance changes and motion history. Rather than using the previous location of the target, we may have a more accurate center to locate the searching region. Benefited from such improved searching region, the match module becomes less prone to the object drift problem, and can easily identify the target from the potential distractors in the background. Extensive experimental results on benchmark datasets such as RGBT, OTB-2013, OTB-50 and OTB-100, show that the proposed method achieves leading performance compared to state-of-the-art trackers. Moreover, the proposed tracker could maintain real-time speed, giving itself the potential in practical applications.
Incremental Pairwise Discriminant Analysis Based Visual Tracking

Jing Wen,Xinbo Gao,Xuelong Li,Dacheng Tao,Jie Li

DOI: https://doi.org/10.1016/j.neucom.2010.07.014

IF: 6

2010-01-01

Neurocomputing

Abstract:The distinguishment between the object appearance and the background is the useful cues available for visual tracking, in which the discriminant analysis is widely applied. However, due to the diversity of the background observation, there are not adequate negative samples from the background, which usually lead the discriminant method to tracking failure. Thus, a natural solution is to construct an object-background pair, constrained by the spatial structure, which could not only reduce the neg-sample number, but also make full use of the background information surrounding the object. However, this idea is threatened by the variant of both the object appearance and the spatial-constrained background observation, especially when the background shifts as the moving of the object. Thus, an incremental pairwise discriminant subspace is constructed in this paper to delineate the variant of the distinguishment. In order to maintain the correct the ability of correctly describing the subspace, we enforce two novel constraints for the optimal adaptation: (1) pairwise data discriminant constraint and (2) subspace smoothness. The experimental results demonstrate that the proposed approach can alleviate adaptation drift and achieve better visual tracking results for a large variety of nonstationary scenes.
Visual Tracking Via Subspace Motion Model

Jun Wang,Fan Zhong,Guofeng Wang,Qunsheng Peng,Xueying Qin

DOI: https://doi.org/10.5244/c.27.110

2013-01-01

Abstract:In this paper we propose a novel motion model for visual tracking, which can be used to parameterize instantaneous image motion caused by both object and camera movements. Our approach is inspired by the subspace theory of image motion, that is, for a rigid object imaged by a projective camera, the displacements matrix of its trajectories over a short period of time should approximately lie in a low-dimensional subspace with a certain rank upper bound. We adopt this subspace as the state transition space in particle filtering, by which we can obtain a state vector with alterable number of dimensions. The dimension number as well as the sampling weight for each dimension at each moment can be determined by the rank of the subspace. In this way the particle distribution will be more coincide with the probability of the object state. Based on the subspace motion model, we derive a new visual tracking approach that can handle more complicated cases. The subspace is also used to discriminate new feature points of the object for adaptively updating the motion model. Experimental results and comparisons demonstrate the effectiveness of the proposed method.
Occlusion-Aware Visual Object Tracking Based on Multi-template Updating Siamese Network

Lifan Sun,Jiayi Zhang,Dan Gao,Bo Fan,Zhumu Fu

DOI: https://doi.org/10.1016/j.dsp.2024.104440

IF: 2.92

2024-02-01

Digital Signal Processing

Abstract:Visual object tracking is a crucial area of computer vision research. It aims to accurately track objects in videos with challenges such as occlusion, deformation, and lighting variations. Existing algorithms face difficulties when objects leave the camera or reappear after being occluded, and they also struggle to track objects with significant appearance changes. To address these issues, this study proposed a novel tracking algorithm. It combines tracking and detection, enabling global searching when objects are occluded or disappear and redetecting them when they reappear. A multi-template updating mechanism was used to adapt to changes in appearance. The study proposed the OTB100-AB and UAV123-AB datasets to evaluate the tracker's ability to handle target disappearance, along with the TNR metric. The proposed algorithm was evaluated on these datasets, as were OTB50 and UAV20L, which outperformed state-of-the-art algorithms and significantly improved tracking performance.

engineering, electrical & electronic
Robust Visual Tracking Based on Incremental Tensor Subspace Learning

Xi Li,Weiming Hu,Zhongfei Zhang,Xiaoqin Zhang,Guan Luo

DOI: https://doi.org/10.1109/iccv.2007.4408950

2007-01-01

Abstract:Most existing subspace analysis-based tracking algorithms utilize a flattened vector to represent a target, resulting in a high dimensional data learning problem. Recently, subspace analysis is incorporated into the multilinear framework which offline constructs a representation of image ensembles using high-order tensors. This reduces spatio-temporal redundancies substantially, whereas the computational and memory cost is high. In this paper, we present an effective online tensor subspace learning algorithm which models the appearance changes of a target by incrementally learning a low-order tensor eigenspace representation through adaptively updating the sample mean and eigenbasis. Tracking then is led by the state inference within the framework in which a particle filter is used for propagating sample distributions over the time. A novel likelihood function, based on the tensor reconstruction error norm, is developed to measure the similarity between the test image and the learned tensor subspace model during the tracking. Theoretic analysis and experimental evaluations against a state-of-the-art method demonstrate the promise and effectiveness of this algorithm.
Adaptive visual tracking with failure detection

Ping Lu,Shuo Deng,Yan Gao,Weiwei Zheng,Huimin Yu

DOI: https://doi.org/10.1109/CISP.2015.7407842

2015-01-01

Abstract:Most traditional visual tracking algorithms ignore the importance of tracking failure detection which is helpful for occlusion handling. To address this problem, a robust visual tracking algorithm combining the tracking model and the failure detection strategy is proposed for the needs of practical applications. In order to tracking the position and scale of the target with high speed and accuracy, a method that estimates the target scale after localization is proposed. When tracking, online SVM is used to estimate the location of the target. Then, variable patches with different sizes are sampled at the estimated location to get scores from the SVM, among which the one scored highest is selected to be the target object. Moreover, a failure detection strategy is introduced based on Log-polar transformation, Gaussian mixture model, and time-domain filtering. For this failure detection model, Log-polar transformation is adopted as it is much more sensitive to drift than scaling and rotation. Thus, whether the target has disappeared or not can be easily judged by the degree of drift using Log-polar transformation and Gaussian mixture model. The time-domain filtering scheme is used to reduce the false-alarm probability, and makes the failure detection more robust. Experimental evaluation on standard visual tracking datasets demonstrates the superiority of our algorithm by comparing with state-of-the-art trackers such as Struck and TLD.
Object Tracking Using Incremental 2D-LDA Learning and Bayes Inference.

Guorong Li,Dawei Liang,Qingming Huang,Shuqiang Jiang,Wen Gao

DOI: https://doi.org/10.1109/icip.2008.4712068

2008-01-01

Abstract:The appearances of the tracked object and its surrounding background usually change during tracking. As for tracking methods using subspace analysis, fixed subspace basis tends to cause tracking failure. In this paper, a novel tracking method is proposed by using incremental 2D-LDA learning and Bayes inference. Incremental 2D-LDA formulates object tracking as online classification between foreground and background. It updates the row- or/and column- projected matrix efficiently. Based on the current object location and the prior knowledge, the possible locations of the object (candidates) in the next frame are predicted using simple sampling method. Applying 2D-LDA projection matrix and Bayes inference, candidate that maximizes the posterior probability is selected as the target object. Moreover, informative background samples are selected to update the subspace basis. Experiments are performed on image sequences with the object's appearance variations due to pose, lighting, etc. We also make comparison to incremental 2D-PCA and incremental FDA. The experimental results demonstrate that the proposed method is efficient and outperforms both the compared methods.
MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

Zhihui Wang,Mingshuai Li,Zhiyuan Li,Xingli Zhang,Ming Li,Zhao Li,Weiping Ding,Xindong Wu

DOI: https://doi.org/10.1109/tetci.2024.3436842

2024-01-01

IEEE Transactions on Emerging Topics in Computational Intelligence

Abstract:Visual tracking is a vitally important task in computer vision, which is widely used in intelligent surveillance and traffic control, etc. Currently, real-time multiple object tracking methods are still not mature in practical applications and still need to be further refined to enhance their performance especially in complex and crowded environments. These existing tracking methods focus on designing the strategies of target association, based on the predictions of object detectors. Since the detection and association phases are independent, many duplicate calculations may occur in the feature extraction procedure, which is time-consuming. Aiming to effectively combine these two phases, an integrated network architecture is proposed in this work to extract the common features for object detection and the differentiating features for target association simultaneously. The multi-task head structure and the specific loss function of this integrated network have been designed to avoid coupling issues in the model training procedure. Furthermore, sample groups of adjacent frames are used to enhance the processing capacity of the personal gradual variance of these tracked targets. Background modeling and a Kalman filter are used to improve tracking accuracy. In the simulation, the proposed tracker achieves better performance than other state-of-the-art trackers on the tested publicly available databases.
Visual Tracking Via Subspace Learning: A Discriminative Approach.

Yao Sui,Yafei Tang,Li Zhang,Guanghui Wang

DOI: https://doi.org/10.1007/s11263-017-1049-z

IF: 13.369

2017-01-01

International Journal of Computer Vision

Abstract:Good tracking performance is in general attributed to accurate representation over previously obtained targets and/or reliable discrimination between the target and the surrounding background. In this work, a robust tracker is proposed by integrating the advantages of both approaches. A subspace is constructed to represent the target and the neighboring background, and their class labels are propagated simultaneously via the learned subspace. In addition, a novel criterion is proposed, by taking account of both the reliability of discrimination and the accuracy of representation, to identify the target from numerous target candidates in each frame. Thus, the ambiguity in the class labels of neighboring background samples, which influences the reliability of the discriminative tracking model, is effectively alleviated, while the training set still remains small. Extensive experiments demonstrate that the proposed approach outperforms most state-of-the-art trackers.
Occlusion-Aware Real-Time Object Tracking

Xingping Dong,Jianbing Shen,Dajiang Yu,Wenguan Wang,Jianhong Liu,Hua Huang

DOI: https://doi.org/10.1109/tmm.2016.2631884

IF: 7.3

2017-01-01

IEEE Transactions on Multimedia

Abstract:The online learning methods are popular for visual tracking because of their robust performance for most video sequences. However, the drifting problem caused by noisy updates is still a challenge for most highly adaptive online classifiers. In visual tracking, target object appearance variation, such as deformation and long-term occlusion, easily causes noisy updates. To overcome this problem, a new real-time occlusion-aware visual tracking algorithm is introduced. First, we learn a novel two-stage classifier with circulant structure with kernel, named integrated circulant structure kernels (ICSK). The first stage is applied for transition estimation and the second is used for scale estimation. The circulant structure makes our algorithm realize fast learning and detection. Then, the ICSK is used to detect the target without occlusion and build a classifier pool to save these classifiers with noisy updates. When the target is in heavy occlusion or after longterm occlusion, we redetect it using an optimal classifier selected from the classifier-pool according to an entropy minimization criterion. Extensive experimental results on the full benchmark demonstrate our real-time algorithm achieves better performance than state-of-the-art methods.
Visual Tracking Using Iterative Sparse Approximation

Huaping Liu,Fuchun Sun,Meng Gao

DOI: https://doi.org/10.1007/978-3-642-21090-7_25

2011-01-01

Abstract:Recent research has advocated the use of sparse representation for tracking objects instead of the conventional histogram object representation models used in popular algorithms. In this paper we propose a new tracker. The core is that the tracking results is iteratively updated by gradually optimizing the sparsity and reconstruction error. The effectiveness of the proposed approach is demonstrated via comparative experiments.
Visual Tracking with Long-Short Term Based Correlation Filter

Yuxiang Yang,Weiwei Xing,Shunli Zhang,Limin Gao,Qi Yu,Xiaoping Che,Wei Lu

DOI: https://doi.org/10.1109/access.2020.2968125

IF: 3.9

2020-01-01

IEEE Access

Abstract:Visual object tracking is a fundamental problem in computer vision, and has been greatly improved with the rapid development of deep learning. However, existing tracking methods with single model update strategy cannot guarantee the robustness of tracker in complex scenes. In this paper, we innovatively propose a novel real-time long-short-term multi-model based tracking method. For the fusion of long-term and short-term features contain more spatiotemporal information, three models with different update periods are designed to learn the long-term and short-term features to improve the tracking robustness. Besides, the hierarchical feature contain deep convolution features and handcraft features are used to represent the current object, which can further improve the tracking accuracy with richer semantic information. Finally, to solve the inaccurate prediction of object position due to the cosine window in the correlation filter, the bounding-box regression strategy is introduced to optimize the final object position. Extensive experiments on OTB, VOT, TC128, and UAV123 datasets demonstrate that the proposed method performs favorably against state-of-the-art algorithms while running at 24 fps.
Joint spatio-temporal modeling for visual tracking

Yumei Sun,Chuanming Tang,Hui Luo,Qingqing Li,Xiaoming Peng,Jianlin Zhang,Meihui Li,Yuxing Wei

DOI: https://doi.org/10.1016/j.knosys.2023.111206

IF: 8.139

2024-01-01

Knowledge-Based Systems

Abstract:Similarity-based approaches have made significant progress in visual object tracking (VOT). Although these methods work well in simple scenes, they ignore the continuous spatio-temporal connection of the object in the video sequence. For this reason, tracking by spatial matching solely can lead to tracking failures because of distractors and occlusion. In this paper, we propose a spatio-temporal joint-modeling tracker named STTrack which implicitly builds continuous connections between the temporal and spatial aspects of the sequence. Specifically, we first design a time-sequence iteration strategy (TSIS) to concentrate on the temporal connection of the object in the video sequence. Then, we propose a novel spatial temporal interaction Transformer network (STIN) to capture the spatio-temporal correlation of the object between frames. The proposed STIN module is robust in object occlusion because it explores the dynamic state change dependencies of the object. Finally, we introduce a spatio-temporal query to suppress distractors by iteratively propagating the target prior. Extensive experiments on six tracking benchmark datasets demonstrate that the proposed STTrack achieves excellent performance while operating in real-time. The code is publicly available at https://github.com/nubsym/STTrack.

computer science, artificial intelligence
Incremental Learning of Weighted Tensor Subspace for Visual Tracking.

Jing Wen,Xinbo Gao,Xuelong Li,Dacheng Tao

DOI: https://doi.org/10.1109/icsmc.2009.5346874

2009-01-01

Abstract:Tensor analysis has been widely utilized in image-related machine learning applications, which has preferable performance over the vector-based approaches for its capability of holding the spatial structure information in some research field. The traditional tensor representation only includes the intensity values, which is sensitive to illumination variation. For this purpose, a weighted tensor subspace (WTS) is defined as object descriptor by combining the Retinex image with the original image. Then, an incremental learning algorithm is developed for WTS to adapt to the appearance change during the tracking. The proposed method could learn the lightness changing incrementally and get robust tracking performance under various luminance conditions. The experimental results illustrate the effectiveness of the proposed visual tracking scheme.

Object tracking with adaptive multicue incremental visual tracker

Weighted Incremental Subspace Learning Algorithm Suitable for Object Tracking

Robust visual tracking via weighted incremental subspace learning

Object Tracking Method Based on Incrementally Updating Linear Discriminant Subspace

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Multi-features Guided Robust Visual Tracking.

MATI: Multimodal Adaptive Tracking Integrator for Robust Visual Object Tracking

Visual Object Tracking Via Guessing and Matching

Incremental Pairwise Discriminant Analysis Based Visual Tracking

Visual Tracking Via Subspace Motion Model

Occlusion-Aware Visual Object Tracking Based on Multi-template Updating Siamese Network

Robust Visual Tracking Based on Incremental Tensor Subspace Learning

Adaptive visual tracking with failure detection

Object Tracking Using Incremental 2D-LDA Learning and Bayes Inference.

MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

Visual Tracking Via Subspace Learning: A Discriminative Approach.

Occlusion-Aware Real-Time Object Tracking

Visual Tracking Using Iterative Sparse Approximation

Visual Tracking with Long-Short Term Based Correlation Filter

Joint spatio-temporal modeling for visual tracking

Incremental Learning of Weighted Tensor Subspace for Visual Tracking.