A Simple Feedforward Convolutional Conceptor Neural Network for Classification

Guangwu Qian,Lei Zhang
DOI: https://doi.org/10.1016/j.asoc.2017.08.016
IF: 8.7
2018-01-01
Applied Soft Computing
Abstract:Training deep neural networks usually invokes error gradient backpropagation (BP), which costs a long training time even on high-performance computing devices or with professional skills of experienced experimenters. In order to accelerate and simplify the training process of deep networks, non-iterative training procedures have been proposed. Here we present another non-iterative approach, Feedforward Convolutional Conceptor Neural Network (FCCNN), for training feedforward networks on image classification tasks. Our work makes two major contributions: (1) a conceptor based classifier which is specific for non-temporal data; (2) a simple non-iterative neural network model. The architecture is established based on the combination of a Convolutional Neural Network (CNN) shaped by an unsupervised feature learning based on Principal Component Analysis (PCA), binary thresholding and the proposed non-temporal conceptor classifier. Through various experiments on MNIST variation datasets, FCCNN achieves classifying accuracy comparable to the state-of-the-art methods while requires significantly reduced training time. (C) 2017 Elsevier B.V. All rights reserved.
What problem does this paper attempt to address?