Abstract:Deep learning seeks to achieve excellent performance for representation learning in image datasets. However, supervised deep learning models such as convolutional neural networks require a large number of labeled image data, which is intractable in applications, while unsupervised deep learning models like stacked denoising auto-encoder cannot employ label information. Meanwhile, the redundancy of image data incurs performance degradation on representation learning for aforementioned models. To address these problems, we propose a semi-supervised deep learning framework called stacked convolutional sparse auto-encoder, which can learn robust and sparse representations from image data with fewer labeled data records. More specifically, the framework is constructed by stacking layers. In each layer, higher layer feature representations are generated by features of lower layers in a convolutional way with kernels learned by a sparse auto-encoder. Meanwhile, to solve the data redundance problem, the algorithm of Reconstruction Independent Component Analysis is designed to train on patches for sphering the input data. The label information is encoded using a Softmax Regression model for semi-supervised learning. With this framework, higher level representations are learned by layers mapping from image data. It can boost the performance of the base subsequent classifiers such as support vector machines. Extensive experiments demonstrate the superior classification performance of our framework compared to several state-of-the-art representation learning methods.

A New Training Principle for Stacked Denoising Autoencoders

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

An Adaptive Image Denoising Method Based on Deep Rectified Denoising Auto-Encoder

Adaptive Image Denoising Based on Improved Stacked Sparse Denoising Auto-Encoder

Research of Stacked Denoising Sparse Autoencoder.

Training Stacked Denoising Autoencoders for Representation Learning

Stacked Convolutional Denoising Auto-Encoders for Feature Representation

Denoising Auto-Encoders Toward Robust Unsupervised Feature Representation.

Representation Learning Via a Semi-Supervised Stacked Distance Autoencoder for Image Classification

Denoising Hybrid Noises in Image with Stacked Autoencoder

Image denoising based on improved stacked sparse denoising autoencoder

Adaptive Noise Level for Stacked Denoising Autoencoder

Deep Marginalized Sparse Denoising Auto-Encoder for Image Denoising

Stacked autoencoders based machine learning for noise reduction and signal reconstruction in geophysical data

Stacked Convolutional Sparse Auto-Encoders for Representation Learning

Remote Sensing Image Classification Based on Stacked Denoising Autoencoder

The Hidden Layer Design for Staked Denoising Autoencoder

Stacked Similarity-Aware Autoencoders.

On building ensembles of stacked denoising auto-encoding classifiers and their further improvement

On a Streaming Approach for Training Denoising Auto-encoders.

Stacked Auto-Encoders for Feature Extraction with Neural Networks.