Abstract:The idea of representing images using a bag of visual words is currently popular in object category recognition. Since this representation is typically constructed using unsupervised clustering, the resulting visual words may not capture the desired information. Recent work has explored the construction of discriminative visual codebooks that explicitly consider object category information. However, since the codebook generation process is still disconnected from that of classifier training, the set of resulting visual words, while individually discriminative, may not be those best suited for the classifier This paper proposes a novel optimization framework that unifies codebook generation with classifier training. In our approach, each image feature is encoded by a sequence of "visual bits" optimized for each category. An image, which can contain objects from multiple categories, is represented using aggregates of visual bits for each category. Classifiers associated with different categories determine how well a given image corresponds to each category. Based on the performance of these classifiers on the training data, we augment the visual words by generating additional bits. The classifiers are then updated to incorporate the new representation. These two phases are repeated until the desired performance is achieved. Experiments compare our approach to standard clustering-based methods and with state-of-the-art discriminative visual codebook generation. The significant improvements over previous techniques clearly demonstrate the value of unifying representation and classification into a single optimization framework.

Visual Recognition Using Density Adaptive Clustering

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Image Texture Clustering Based on Locality Preserving Projection

Texture Clustering Combining Complex Wavelet Features and Local Binary Pattern

Efficient and Effective Visual Codebook Generation Using Additive Kernels

Beyond the Euclidean Distance: Creating Effective Visual Codebooks Using the Histogram Intersection Kernel

Learning visual codebooks for image classification using spectral clustering

Codebook Enhancement of Vlad Representation for Visual Recognition.

Spatial Locality-Preserving Feature Coding for Image Classification

Improved K-means Algorithm Using Initialization Technique Based on Edge-Mean Grid for Image Vector Quantizer Design.

Learning Affine Robust Binary Codes Based on Locality Preserving Hash

Common Visual Pattern Discovery Via Nonlinear Mean Shift Clustering

A Fast Algorithm For Creating A Compact And Discriminative Visual Codebook

VQ Codebook Design Using Modified K-means Algorithm with Feature Classification and Grouping Based Initialization

Local Quantization Code Histogram for Texture Classification

Mobile Visual Search Based on Histogram Matching and Zone Weight Learning

Exploiting Feature Correspondence Constraints for Image Recognition

Unifying Discriminative Visual Codebook Generation with Classifier Training for Object Category Recognition

Towards Codebook-Free: Scalable Cascaded Hashing for Mobile Image Search

Sub-Selective Quantization for Large-Scale Image Search

Building Descriptive and Discriminative Visual Codebook for Large-Scale Image Applications.