Abstract:Face recognition algorithms based on deep convolutional neural networks (DCNNs) have made progress on the task of recognizing faces in unconstrained viewing conditions. These networks operate with compact feature-based face representations derived from learning a very large number of face images. While the learned features produced by DCNNs can be highly robust to changes in viewpoint, illumination, and appearance, little is known about the nature of the face code that emerges at the top level of such networks. We analyzed the DCNN features produced by two face recognition algorithms. In the first set of experiments we used the top-level features from the DCNNs as input into linear classifiers aimed at predicting metadata about the images. The results show that the DCNN features contain surprisingly accurate information about the yaw and pitch of a face, and about whether the face came from a still image or a video frame. In the second set of experiments, we measured the extent to which individual DCNN features operated in a view-dependent or view-invariant manner. We found that view-dependent coding was a characteristic of the identities rather than the DCNN features - with some identities coded consistently in a view-dependent way and others in a view-independent way. In our third analysis, we visualized the DCNN feature space for over 24,000 images of 500 identities. Images in the center of the space were uniformly of low quality (e.g., extreme views, face occlusion, low resolution). Image quality increased monotonically as a function of distance from the origin. This result suggests that image quality information is available in the DCNN features, such that consistently average feature values reflect coding failures that reliably indicate poor or unusable images. Combined, the results offer insight into the coding mechanisms that support robust representation of faces in DCNNs.

Deep convolution neural network learning based on deconvolution feature extraction

Research on Image Classification Method of Features of Combinatorial Convolution

Deconvolution-and-convolution Networks

Learning Discriminative Shrinkage Deep Networks for Image Deconvolution

Fast image classification algorithm based on deep convolutional neural network

Deep Deconvolution Neural Network for Image Super-Resolution

Training Very Deep CNNs for General Non-Blind Deconvolution.

Gradient-Guided DCNN for Inverse Halftoning and Image Expanding

Learning Deep Gradient Descent Optimization for Image Deconvolution

Learning Deep Representations Using Convolutional Auto-Encoders with Symmetric Skip Connections

Multi-scale Convolutional Neural Networks for Non-blind Image Deconvolution.

Non-blind Image Deconvolution Using Deep Dual-Pathway Rectifier Neural Network

Deep Vanishing Component Analysis Network for Pattern Classification

Hyperspectral Image Classification Based on Deep Deconvolution Network with Skip Architecture

FCNet: a Deep Neural Network Based on Multi-Channel Feature Cascading for Image Denoising

Deep Convolutional Neural Network Features and the Original Image

Convolutional Adaptive Denoising Autoencoders for Hierarchical Feature Extraction

Fine-Grained Image Classification Using Modified DCNNs Trained by Cascaded Softmax and Generalized Large-Margin Losses

Learning Sparse Features In Convolutional Neural Networks For Image Classification

Learning Fully Convolutional Networks for Iterative Non-blind Deconvolution

Image Denoising Method Based on a Deep Convolution Neural Network