Abstract:Bag-of-features based approaches have become prominent for image retrieval and image classification tasks in the past decade. Such methods represent an image as a collection of local features, such as image patches and key points with scale invariant feature transform (SIFT) descriptors. To improve the bag-of-features methods, we first model the assignments of local descriptors as contribution functions, and then propose a novel multiple assignment strategy. Assuming the local features can be reconstructed by their neighboring visual words in a vocabulary, reconstruction weights can be solved by quadratic programming. The weights are then used to build contribution functions, resulting in a novel assignment method, called quadratic programming (QP) assignment. We further propose a novel visual word weighting method. The discriminative power of each visual word is analyzed by the sub-similarity function in the bin that corresponds to the visual word. Each sub-similarity function is then treated as a weak classifier. A strong classifier is learned by boosting methods that combine those weak classifiers. The weighting factors of the visual words are learned accordingly. We evaluate the proposed methods on medical image retrieval tasks. The methods are tested on three well-known data sets, i.e., the ImageCLEFmed data set, the 304 CT Set, and the basal-cell carcinoma image set. Experimental results demonstrate that the proposed QP assignment outperforms the traditional nearest neighbor assignment, the multiple assignment, and the soft assignment, whereas the proposed boosting based weighting strategy outperforms the state-of-the-art weighting methods, such as the term frequency weights and the term frequency-inverse document frequency weights.

Improving Bag-of-words Representation with Efficient Twin Feature Integration.

Improving feature matching strategies for efficient image retrieval

Discriminative Features for Image Classification and Retrieval

A Hierarchal BoW for Image Retrieval by Enhancing Feature Salience.

A New Bag-of-words Model Using Multi-Cue Integration for Image Retrieval

E2BoWs: an End-to-end Bag-of-Words Model Via Deep Convolutional Neural Network for Image Retrieval

A Multi-Sample, Multi-Tree Approach to Bag-of-words Image Representation for Image Retrieval

Coupled Binary Embedding for Large-Scale Image Retrieval

Variable-Weight and Multi-index Similarity Measure for Feature Fusion

Feature integration analysis of bag-of-features model for image retrieval.

A Novel Image Retrieval Approach With Bag-Of-Word Model And Gabor Feature

Joint Optimization Toward Effective and Efficient Image Search

Twin Feature and Similarity Maximal Matching for Image Retrieval

Robust Feature Encoding with Neighborhood Information for Image Classification

Spatially aware feature selection and weighting for object retrieval

Improving Bag-of-Features for Large Scale Image Search

Feature First: Advancing Image-Text Retrieval Through Improved Visual Features

An Improved Remote Sensing Image Retrieval Method Based on Bag of Word Framework

Face Recognition Using the Improved Bag of Words Model

The Extended Bag of Words Model for Visual Recognition and Categorization

Bag-Of-Features Based Medical Image Retrieval Via Multiple Assignment And Visual Words Weighting