Individual Adaptive Metric Learning for Visual Tracking

Sihua Yi,Nan Jiang,Xinggang Wang,Wenyu Liu

DOI: https://doi.org/10.1016/j.neucom.2016.01.052

IF: 6

2016-01-01

Neurocomputing

Abstract:Recent attempts demonstrate that learning an appropriate distance metric in visual tracking applications can improve the tracking performance. However, the existing metric learning methods learn and adjust the distance between all pairwise sample points in an iterative way, which raises the time consumption issue in real-time tracking applications. To address this problem, this paper proposes a novel metric learning method and applies it to visual tracking. The main idea of the proposed method is to adapt the distance from each individual sample point to a few anchor points instead of the distance between all pairs of samples, so as to reduce the number of distances to be adjusted. Based on this idea, we construct a convex matrix function that collapses the sample points to their class centers and maximizes the inter-class distance. Given n training samples in d-dimensional space, the equation can be solved in a closed form with the computational complexity of O(d2n). This is much more computationally efficient than traditional methods with the computational complexity of O(dn2) in each iteration (normally in tracking applications, d⪡n). Furthermore, the proposed method can be learned in an online manner which is able to accelerate the learning process and improve the matching accuracy in visual tracking applications. Experiments on UCI datasets demonstrate that the proposed learning method is comparable with the traditional metric learning methods in term of classification accuracy but much more time efficient. The comparison experiments on benchmark video sequences show that the tracking algorithm based on our learning approach can outperform the state-of-the-art tracking algorithms.