Abstract:We propose a random convolutional neural network to generate a feature space in which we study image classification and retrieval performance. Put briefly we apply random convolutional blocks followed by global average pooling to generate a new feature, and we repeat this k times to produce a k-dimensional feature space. This can be interpreted as partitioning the space of image patches with random hyperplanes which we formalize as a random depthwise convolutional neural network. In the network's final layer we perform image classification and retrieval with the linear support vector machine and k-nearest neighbor classifiers and study other empirical properties. We show that the ratio of image pixel distribution similarity across classes to within classes is higher in our network's final layer compared to the input space. When we apply the linear support vector machine for image classification we see that the accuracy is higher than if we were to train just the final layer of VGG16, ResNet18, and DenseNet40 with random weights. In the same setting we compare it to an unsupervised feature learning method and find our accuracy to be comparable on CIFAR10 but higher on CIFAR100 and STL10. We see that the accuracy is not far behind that of trained networks, particularly in the top-k setting. For example the top-2 accuracy of our network is near 90% on both CIFAR10 and a 10-class mini ImageNet, and 85% on STL10. We find that k-nearest neighbor gives a comparable precision on the Corel Princeton Image Similarity Benchmark than if we were to use the final layer of trained networks. As with other networks we find that our network fails to a black box attack even though we lack a gradient and use the sign activation. We highlight sensitivity of our network to background as a potential pitfall and an advantage. Overall our work pushes the boundary of what can be achieved with random weights.

Markov Random Field Based Convolutional Neural Networks for Image Classification

Deep Neural Networks With Markov Random Field Models For Image Classification

Data-Independent Feature Learning with Markov Random Fields in Convolutional Neural Networks

Research on Image Classification Method of Features of Combinatorial Convolution

Combining of Markov Random Field and Convolutional Neural Networks for Hyper/Multispectral Image Classification.

Study On Image Classification With Convolution Neural Networks

Hyperspectral Image Classification with Transfer Learning and Markov Random Fields.

Markov random field based spectral-spatial fusion network for hyperspectral image classification

Convolutional Fuzzy Neural Networks with Random Weights for Image Classification

Invariant Feature Extraction for Image Classification Via Multi-Channel Convolutional Neural Network

Hyperspectral Image Classification with Markov Random Fields and a Convolutional Neural Network

Context-based conditional random fields as recurrent neural networks for image labeling

Simple convolutional neural network on image classification

SAR Image Classification Using Markov Random Fields with Deep Learning

Characterizing Markov Random Fields and Coefficient of Variations as Measures of Spatial Distributions for Hyperspectral Image Classification

A Survey: Image Classification Models Based on Convolutional Neural Networks

Environmental Microorganism Classification Using Conditional Random Fields and Deep Convolutional Neural Networks

Image classification algorithm using Markov random field and multiple kernel learning

Convolutional Neural Networks from Image Markers

Modelling Spatial Correlations by Using Deep CNN and LSTM for Texture Image Classification

Image classification and retrieval with random depthwise signed convolutional neural networks