Abstract:Local image features can be assumed to be drawn from an unknown distribution. For image classification, such features are compared through the histogram-based model or the metric-based model. By quantizing these local features into a set of histograms, the histogram-based model is convenient and has vectorial representation of image but information could be lost in vector quantization. Unlike the histogram-based model, the metric-based model estimates the metrics over the underlying distribution of local features immediately, achieving better predictive performance. However, the model requires higher computational cost and loses the benefit of vectorial representation of image.To retain the advantages of these two models, this paper proposes the (doubly) randomized distribution features that represent the underlying distribution of local features in each image as a vectorial feature by utilizing random Fourier feature. We prove the convergences of the similarity and distance based on the randomized distribution feature. Remarkable advantages of the randomized distribution feature are that it has vectorial representation and thus computes efficiently as the histogram-based model. Besides, it provides rigorous theory guarantee and competitive performance as the metric-based model. Compared with several state-of-the-art algorithms, experiments in three real-world datasets justify that our proposed approaches attain competitive classification accuracy with faster computational speed. Furthermore, we indicate that our proposed features can utilize the methods in learning based on vectors, which are broadly studied in traditional machine learning domain, to deal with the problems in learning based on distribution.

Framework of Randomized Distribution Features for Visual Representation and Categorization.

Randomized Distribution Feature for Image Classification.

Understanding bag-of-words model: a statistical framework

A Unified Feature Representation and Learning Framework for 3D Shape

Metric Distribution to Vector: Constructing Data Representation via Broad-Scale Discrepancies

FPFH Revisited: Histogram Resolutions, Improved Features, and Novel Representation

A Discriminative Vectorial Framework for Multi-modal Feature Representation

Randomized Locality Sensitive Vocabularies For Bag-Of-Features Model

Concept Drift and Long-Tailed Distribution in Fine-Grained Visual Categorization: Benchmark and Method

Deep Randomized Ensembles for Metric Learning

Geometric Covering using Random Fields

On Data-Dependent Random Features for Improved Generalization in Supervised Learning

Metric forests based on Gaussian mixture model for visual image classification

A Double-Variational Bayesian Framework in Random Fourier Features for Indefinite Kernels

Binary Feature from Intensity Quantization and Weakly Spatial Contextual Coding for Image Search.

A joint appearance-spatial distance for kernel-based image categorization

Feature representation for statistical-learning-based object detection

Deep-seated features histogram: A novel image retrieval method

Dimension Reduction for Fréchet Regression

Improved Random Features for Dot Product Kernels

Learning Random Fourier Features by Hybrid Constrained Optimization