Abstract:Deep learning seeks to achieve excellent performance for representation learning in image datasets. However, supervised deep learning models such as convolutional neural networks require a large number of labeled image data, which is intractable in applications, while unsupervised deep learning models like stacked denoising auto-encoder cannot employ label information. Meanwhile, the redundancy of image data incurs performance degradation on representation learning for aforementioned models. To address these problems, we propose a semi-supervised deep learning framework called stacked convolutional sparse auto-encoder, which can learn robust and sparse representations from image data with fewer labeled data records. More specifically, the framework is constructed by stacking layers. In each layer, higher layer feature representations are generated by features of lower layers in a convolutional way with kernels learned by a sparse auto-encoder. Meanwhile, to solve the data redundance problem, the algorithm of Reconstruction Independent Component Analysis is designed to train on patches for sphering the input data. The label information is encoded using a Softmax Regression model for semi-supervised learning. With this framework, higher level representations are learned by layers mapping from image data. It can boost the performance of the base subsequent classifiers such as support vector machines. Extensive experiments demonstrate the superior classification performance of our framework compared to several state-of-the-art representation learning methods.

An Image Classifier Based on Stacked Autoencoder

Representation Learning Via a Semi-Supervised Stacked Distance Autoencoder for Image Classification

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Study on Image Recognition Based on Stacked Sparse Auto-encoder

Research on Image Classification Method of Features of Combinatorial Convolution

A Particle Swarm Optimization-Based Flexible Convolutional Autoencoder for Image Classification

Stacked Auto-Encoders for Feature Extraction with Neural Networks.

A Stacked Multi-Granularity Convolution Denoising Auto-Encoder.

Feature-Aligned Stacked Autoencoder: A Novel Semisupervised Deep Learning Model for Pattern Classification of Industrial Faults

Image denoising based on improved stacked sparse denoising autoencoder

Denoising Auto-Encoders Toward Robust Unsupervised Feature Representation.

Remote Sensing Image Classification Based on Stacked Denoising Autoencoder

Stacked What-Where Auto-encoders

Stacked Convolutional Sparse Auto-Encoders for Representation Learning

Hyperspectral Remote Sensing Image Classification Based on Auto-Encoder

A Particle Swarm Optimization-based Flexible Convolutional Auto-Encoder for Image Classification

Adaptive Image Denoising Based on Improved Stacked Sparse Denoising Auto-Encoder

Stacked Similarity-Aware Autoencoders.

Stacked Autoencoder-based deep learning for remote-sensing image classification: a case study of African land-cover mapping

Stacked Convolutional Denoising Auto-Encoders for Feature Representation

Pedestrian Classification by Using Stacked Sparse Autoencoders.