Abstract:Person re-identification is to seek a correct match for a person of interest across different camera views among a large number of impostors. It typically involves two procedures of non-linear feature extractions against dramatic appearance changes, and subsequent discriminative analysis in order to reduce intra-personal variations while enlarging inter-personal differences. In this paper, we introduce a hybrid deep architecture which combines Fisher vectors and deep neural networks to learn non-linear transformations of pedestrian images to a deep space where data can be linearly separable. The proposed method starts from Fisher vector encoding which computes a sequence of local feature extraction, aggregation, and encoding. The resulting Fisher vector output are fed into stacked supervised layer to seek non-linear transformation into a deep space. On top of the deep neural network, Linear Discriminant Analysis (LDA) is reinforced such that linearly separable latent representations can be learned in an end-to-end fashion. By optimizing an objective function modified from LDA, the network is enforced to produce feature distributions which have a low variance within the same class and high variance between classes. The objective is essentially derived from the general LDA eigenvalue problem and allows to train the network with Stochastic Gradient Descent and back-propagate LDA gradients to compute Gaussian Mixture Model (GMM) gradients in Fisher vector encoding. For empirical evaluations, we test our approach on four benchmark data sets in person re-identification (VIPeR [1], CUHK03 [2], CUHK01 [3], and Market 1501 [4]). Extensive experiments on these benchmarks show that our method can achieve state-of-the-art results.

Analyzing Classifiers: Fisher Vectors and Deep Neural Networks

Deep Linear Discriminant Analysis on Fisher Networks: A Hybrid Architecture for Person Re-identification

Deep FisherNet for Image Classification

Deep FisherNet for Object Classification

Deep-based Fisher Vector for Mobile Visual Search

Foreground Fisher Vector: Encoding Class-Relevant Foreground to Improve Image Classification

Fisher Large Margin Linear Classifier

Image Classification with CNN-based Fisher Vector Coding

Exploring Fisher Vector and Deep Networks for Action Spotting

Fisher Vector Encoding of Supervoxel-Based Features for Airborne LiDAR Data Classification.

Regularized least squares fisher linear discriminant with applications to image recognition

Hybrid RGB-D object recognition using Convolutional Neural Network and Fisher Vector

Fisher Vector Based CNN Architecture for Image Classification.

FPCANet: Fisher Discrimination for Principal Component Analysis Network

FisherMask: Enhancing Neural Network Labeling Efficiency in Image Classification Using Fisher Information

Deep Marginal Fisher Analysis Based CNN for Image Representation and Classification.

Locally-Transferred Fisher Vectors For Texture Classification

Encoding Deep Residual Features into Fisher Vector for Skin Lesion Classification.

Natural Image Manipulation for Autoregressive Models Using Fisher Scores

Neural network interpretability with layer-wise relevance propagation: novel techniques for neuron selection and visualization

Latent Fisher Discriminant Analysis