Image Classification by Cross-Media Active Learning with Privileged Information

Yan,Feiping Nie,Wen Li,Chenqiang Gao,Yi Yang,Dong Xu
DOI: https://doi.org/10.1109/tmm.2016.2602938
IF: 7.3
2016-01-01
IEEE Transactions on Multimedia
Abstract:In this paper, we propose a novel cross-media active learning algorithm to reduce the effort on labeling images for training. The Internet images are often associated with rich textual descriptions. Even though such textual information is not available in test images, it is still useful for learning robust classifiers. In light of this, we apply the recently proposed supervised learning paradigm, learning using privileged information, to the active learning task. Specifically, we train classifiers on both visual features and privileged information, and measure the uncertainty of unlabeled data by exploiting the learned classifiers and slacking function. Then, we propose to select unlabeled samples by jointly measuring the cross-media uncertainty and the visual diversity. Our method automatically learns the optimal tradeoff parameter between the two measurements, which in turn makes our algorithms particularly suitable for real-world applications. Extensive experiments demonstrate the effectiveness of our approach.
What problem does this paper attempt to address?