A FEATURE EMBEDDING STRATEGY FOR HIGH-LEVEL CNN REPRESENTATIONS FROM MULTIPLE CONVNETS

T. Akilan,Q. M. Jonathan Wu,Wei Jiang
DOI: https://doi.org/10.1109/globalsip.2017.8309150
2017-01-01
Abstract:Recently, pre-trained deep convolutional neural networks (DCNNs or ConvNets) have proven that the high-level features extracted at the top fully connected (FC) layer can improve the accuracy of various image understanding, recognition, and classification tasks. However, it has not been explored if such high-level features from different DCNN architectures contain complementary cues for image representation. Thence, in this paper, we further investigate a feature embedding strategy to exploit high-level features from multiple DCNNs in a framework of image-based object/action classification. We derive a generalized feature space by embedding different high-level features extracted through three ConvNets under Principal component analysis (PCA)-based reconstruction, energy level-based normalization, and five different fusion rules. Test outcomes on four different object classification datasets and an action classification dataset show that regardless of variation in image statistics and tasks the proposed multi-DCNN high-level feature embedding is well suited for the aforesaid tasks and it can be an effective complement of DCNN. In general, we observe that the proposed strategy is highly competitive with other approaches and tends to produce improvement in the classification accuracy.
What problem does this paper attempt to address?