Abstract:The idea of representing images using a bag of visual words is currently popular in object category recognition. Since this representation is typically constructed using unsupervised clustering, the resulting visual words may not capture the desired information. Recent work has explored the construction of discriminative visual codebooks that explicitly consider object category information. However, since the codebook generation process is still disconnected from that of classifier training, the set of resulting visual words, while individually discriminative, may not be those best suited for the classifier This paper proposes a novel optimization framework that unifies codebook generation with classifier training. In our approach, each image feature is encoded by a sequence of "visual bits" optimized for each category. An image, which can contain objects from multiple categories, is represented using aggregates of visual bits for each category. Classifiers associated with different categories determine how well a given image corresponds to each category. Based on the performance of these classifiers on the training data, we augment the visual words by generating additional bits. The classifiers are then updated to incorporate the new representation. These two phases are repeated until the desired performance is achieved. Experiments compare our approach to standard clustering-based methods and with state-of-the-art discriminative visual codebook generation. The significant improvements over previous techniques clearly demonstrate the value of unifying representation and classification into a single optimization framework.

A Hybrid Algorithm Based on Improved LLE and K-Means for Visual Codebook Generation in Scene Classification

Image Classification Method by Combining Multi-features and Sparse Coding

Beyond the Euclidean Distance: Creating Effective Visual Codebooks Using the Histogram Intersection Kernel

Efficient and Effective Visual Codebook Generation Using Additive Kernels

Learning visual codebooks for image classification using spectral clustering

Unifying Discriminative Visual Codebook Generation with Classifier Training for Object Category Recognition

Codebook Enhancement of Vlad Representation for Visual Recognition.

A Fast Algorithm For Creating A Compact And Discriminative Visual Codebook

Visual Recognition Using Density Adaptive Clustering

Spatial Locality-Preserving Feature Coding for Image Classification

Fast Codebook Design Method for Image Vector Quantisation

Bilevel Visual Words Coding for Image Classification

Building Descriptive and Discriminative Visual Codebook for Large-Scale Image Applications.

Visual word coding based on difference maximization.

An Innovative Method to Classify Remote Sensing Images Using Artificial Bee Colony Algorithm

Improved k-means clustering method for codebook generation

Improvements in image categorization using codebook ensembles

A Hierarchical Word-Merging Algorithm with Class Separability Measure

Mobile Visual Search Based on Histogram Matching and Zone Weight Learning

A Hybrid Ensemble Learning Method For Tourist Route Recommendations Based On Geo-Tagged Social Networks

The Fisher Kernel Coding Framework for High Spatial Resolution Scene Classification