Abstract:The MPEG compact descriptors for visual search (CDVS) is a standard toward image matching and retrieval. To achieve high retrieval accuracy over a large scale image/video dataset, recent research efforts have demonstrated that employing extremely high-dimensional descriptors such as the Fisher vector (FV) and the vector of locally aggregated descriptors (VLAD) can yield good performance. Since the FV (or VLAD) possesses high discriminability but small visual vocabulary, it has been adopted by CDVS to construct a global compact descriptor. In this paper, we study the development of global compact descriptors in the completed CDVS standard and the emerging compact descriptors for video analysis (CDVA) standard, in which we formulate the FV (or VLAD) compression as a resource-constrained optimization problem. Accordingly, we propose a codebook-free aggregation method via dual selection to generate a global compact visual descriptor, which supports fast and accurate feature matching free of large visual codebooks, fulfilling the low memory requirement of mobile visual search at significantly reduced latency. Specifically, we investigate both sample-specific Gaussian component redundancy and bit dependency within a binary aggregated descriptor to produce compact binary codes. Our technique contributes to the scalable compressed Fisher vector (SCFV) adopted by the CDVS standard. Moreover, the SCFV descriptor is currently serving as the frame-level hand-crafted video feature, which inspires the inheritance of CDVS descriptors for the emerging CDVA standard. Furthermore, we investigate the positive complementary effect of our standard compliant compact descriptor and deep learning based features extracted from convolutional neural networks with significant mean average precision gains. Extensive evaluation over benchmark databases shows the significant merits of the codebook-free binary codes for scalable visual search.

Coordinate Descent Algorithms for Large-Scale SVDD

Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

An On-Line Learning Approach with Support Vector Dormain Classifier

Fast learning algorithm for support vector domain description

A support vector domain classification algorithm with gray information

AnIncremental Learning Algorithm Basedon Support Vector DomainClassifier

One Kind of Reduced Learning Algorithm for Support Vector Domain Description

Training support vector data descriptors using converging linear particle swarm optimization

Shape Representation and Recognition in High Dimensional Feature Space

An Incremental Learning Algorithm Based on Support Vector Domain Classifier

Large-scale Dictionary Learning for Local Coordinate Coding.

Efficient Outlier Detection Algorithm Based on Support Vector Data Description

Boosting VLAD with Supervised Dictionary Learning and High-Order Statistics.

Accelerated Variance Reduced Block Coordinate Descent

A Complete Deep Support Vector Data Description for One Class Learning.

Feature Clustering for Accelerating Parallel Coordinate Descent

Coordinate Descent Algorithm for Ramp Loss Linear Programming Support Vector Machines

Large Visual Words For Large Scale Image Classification

Building Descriptive and Discriminative Visual Codebook for Large-Scale Image Applications.

Codebook-Free Compact Descriptor for Scalable Visual Search.

Codebook Enhancement of Vlad Representation for Visual Recognition.