Abstract:This paper proposes a generic formulation that significantly expedites the training and deployment of image classification models, particularly under the scenarios of many image categories and high feature dimensions. As a defining property, our method represents both the images and learned classifiers using binary hash codes, which are simultaneously learned from the training data. Classifying an image thereby reduces to computing the Hamming distance between the binary codes of the image and classifiers and selecting the class with minimal Hamming distance. Conventionally, compact hash codes are primarily used for accelerating image search. Our work is first of its kind to represent classifiers using binary codes. Specifically, we formulate multi-class image classification as an optimization problem over binary variables. The optimization alternatively proceeds over the binary classifiers and image hash codes. Profiting from the special property of binary codes, we show that the sub-problems can be efficiently solved through either a binary quadratic program (BQP) or linear program. In particular, for attacking the BQP problem, we propose a novel bit-flipping procedure which enjoys high efficacy and local optimality guarantee. Our formulation supports a large family of empirical loss functions and is here instantiated by exponential / hinge losses. Comprehensive evaluations are conducted on several representative image benchmarks. The experiments consistently observe reduced complexities of model training and deployment, without sacrifice of accuracies.

Design of a brief perceptual loss function with Hadamard codes

Perceptual impact of the loss function on deep-learning image coding performance

Perceptually Optimizing Deep Image Compression

Optimally Controllable Perceptual Lossy Compression

Deep Perceptual Compression

Exploring Compressed Image Representation as a Perceptual Proxy: A Study

CPIPS: Learning to Preserve Perceptual Distances in End-to-End Image Compression

Generic Perceptual Loss for Modeling Structured Output Dependencies

Visually Lossless Coding in HEVC: A High Bit Depth and 4:4:4 Capable JND-Based Perceptual Quantisation Technique for HEVC

Learning Binary Codes and Binary Weights for Efficient Classification

PAD-Net: A Perception-Aided Single Image Dehazing Network

Perceptual Loss for Convolutional Neural Network Based Optical Flow Estimation

A Systematic Performance Analysis of Deep Perceptual Loss Networks: Breaking Transfer Learning Conventions

ProxIQA: A Proxy Approach to Perceptual Optimization of Learned Image Compression

Object-Based Image Coding: A Learning-Driven Revisit

A Survey on Perceptually Optimized Video Coding

On Perceptual Lossy Compression: The Cost of Perceptual Reconstruction and An Optimal Training Framework

High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregation

Projected Distribution Loss for Image Enhancement

Perceptual Learned Image Compression via End-to-End JND-Based Optimization

Lost in binarization: query-adaptive ranking for similar image search with compact codes.