Improving the Anti-Occlusion Ability of Correlation Filter-Based Trackers Via Segmentation

Jiang Kaiwen,Yan Lei,Zhang Zihan,Zhao Hongying
DOI: https://doi.org/10.1007/s10489-021-03058-y
IF: 5.3
2022-01-01
Applied Intelligence
Abstract:In recent years, correlation filter (CF)-based trackers have undergone rapid development and achieved state-of-the-art performance. However, CF-based trackers lack the ability to perceive the local variation of the target, such as occlusion, because they rely on the features from a bounding box to distinguish the target. In contrast, segmentation-based trackers, which distinguish the target based on pixel- or superpixel-level information, can sufficiently perceive local variation. However, their robustness is inferior to that of CF methods due to the lack of high-level semantic information. In this research, the advantages of both methods were combined to improve the anti-occlusion ability of CF trackers. The image segmentation-based occlusion estimation agency (ISBOEA) method is proposed to perceive occlusions, after which the occlusion information is used to guide the training and searching of CF trackers. In experiments conducted in this study, two CF-based trackers, namely the background-aware CF (BACF) and the efficient convolution operators: hand-crafted feature version (ECO_HC), were employed as baselines for tracking. Moreover, the minimum barrier distance (MBD) transform method was employed to conduct image segmentation. Extensive experiments were performed on standard benchmark datasets, namely OTB50, OTB100, GOT-10k and VIVID. The results demonstrate that the proposed ISBOEA method can remarkably improve the anti-occlusion ability of CF-based trackers.
What problem does this paper attempt to address?