Abstract:The explosive growth of the vision data motivates the recent studies on efficient data indexing methods such as locality-sensitive hashing (LSH). Most existing approaches perform hashing in an unsupervised way. In this paper we move one step forward and propose a supervised hashing method, i.e., the LAbel-regularized Max-margin Partition (LAMP) algorithm. The proposed method generates hash functions in weakly-supervised setting, where a small portion of sample pairs are manually labeled to be “similar” or “dissimilar”. We formulate the task as a Constrained Convex-Concave Procedure (CCCP), which can be relaxed into a series of convex sub-problems solvable with efficient Quadratic-Program (QP). The proposed hashing method possesses other characteristics including: 1) most existing LSH approaches rely on linear feature representation. Unfortunately, kernel tricks are often more natural to gauge the similarity between visual objects in vision research, which corresponds to probably infinite-dimensional Hilbert spaces. The proposed LAMP has a natural support for kernel-based feature representation. 2) traditional hashing methods assume uniform data distributions. Typically, the collision probability of two samples in hash buckets is only determined by pairwise similarity, unrelated to contextual data distribution. In contrast, we provide such a collision bound which is beyond pairwise data interaction based on Markov random fields theory. Extensive empirical evaluations are conducted on five widely-used benchmarks. It takes only several seconds to generate a new hashing function, and the adopted random supporting-vector scheme enables the LAMP algorithm scalable to large-scale problems. Experimental results well validate the superiorities of the LAMP algorithm over the state-of-the-art kernel-based hashing methods.

Hashing Based Prediction for Large-Scale Kernel Machine

Hash-SVM: Scalable Kernel Machines for Large-Scale Visual Classification

Multi-Layer Kernel Machines: Fast and Optimal Nonparametric Regression with Uncertainty Quantification

Toward Large Kernel Models

Double Sparsity Garrotized Kernel Machine in High-Dimensional Partially Linear Model

High-performance Kernel Machines with Implicit Distributed Optimization and Randomization

Kernelized sparse hashing for scalable image retrieval

A Learnable Kernel Machine for Short-Term Load Forecasting

Kernelised Supervised Context Hashing

Multiple Feature Kernel Hashing for Large-Scale Visual Search.

Multiple Riemannian Kernel Hashing for Large-Scale Image Set Classification and Retrieval

Supervised hashing with kernels

Isolation Kernel: The X Factor in Efficient and Effective Large Scale Online Kernel Learning

Weakly-supervised Hashing in Kernel Space

Adaptive Object Retrieval with Kernel Reconstructive Hashing

Online Chaotic Time Series Prediction Using Unbiased Composite Kernel Machine Via Cholesky Factorization

How Many Machines Can We Use in Parallel Computing for Kernel Ridge Regression?

Accelerated Large Scale Optimization by Concomitant Hashing

Iterative Kernel Regression with Preconditioning

Machine Learning Based Performance Analysis and Prediction of Jobs on a HPC Cluster

The Spatial Kernel Predictor based on Huge Observation Sets