Fast Conceptor Classifier in Pre-trained Neural Networks for Visual Recognition.

Guangwu Qian,Lei Zhang,Qianjun Zhang
DOI: https://doi.org/10.1007/978-3-319-59081-3_35
2017-01-01
Abstract:Training large neural network models from scratch is not feasible due to over-fitting on small datasets and time-consuming on large datasets. Hence, to utilize the feature extracting capacity learned by large models, many investigations have been done on various neural network models. At the classifying stage of those models, they employ either a linear SVM classifier or a Softmax classifier, which is the only trained part of the whole model. In this paper, following this line of work, we propose a classifier based on conceptors called Fast Conceptor Classifier (FCC), which is simple to construct and GPU accelerate. Its evaluations with pre-trained and no fine-tuning neural networks have been investigated on Caltech-101 and Caltech-256 datasets, where it achieves state-of-the-art results with the training time reduced by a factor of 60 on average.
What problem does this paper attempt to address?