Image Classification by Codebook Updating via Joint i-Pat Topic Model Feedback Wai

Lam Hoo,Tae-Kyun Kim,Yuru Pei,C. Chan
2014-01-01
Abstract:Image classification is an important task in computer vision as it plays a major role in content-based image retrieval. For an image classification system that uses the Bagof-Words model representation, visual codebook is an essential part. Randomized forest (RF) as a tree-structure discriminative codebook has been proven highly time-efficient for real-world applications, by utilizing the image class labels which the detected features are associated with (i.e. weakly supervised learning). However, the RF codebook can be degraded if the image class labels are poorly labeled. In this paper, we tackle this image class label problem by proposing a feedback mechanism from the topic model. This statistical model can hypothesize the ‘correct’ labels for images, to enhance the effectiveness of the RF codebook. Besides, the feedback mechanism employs a joint image-patch (i-Pat) level information in predicting the ‘correct’ labels, which is in contrast to the state-of-the-art RF learning. Experiments on both the 15-Scene and C-Pascal datasets had shown that the proposed method outperforms existing methods by a margin. Besides, even with limited labeled training images, the proposed solution still able to achieve comparable accuracy compared to the fully labeled training data algorithm.
What problem does this paper attempt to address?