Abstract:Scene classification of high-resolution remote sensing (RS) images has attracted increasing attentions due to its vital role in a wide range of applications. Convolutional neural networks (CNNs) have recently been applied on many computer vision tasks and have significantly boosted the performance including imagery scene classification, object detection, and so on. However, the classification performance heavily relies on the features that can accurately represent the scene of images, thus, how to fully explore the feature learning ability of CNNs is of crucial importance for scene classification. Another problem in CNNs is that it requires a large number of labeled samples, which is impractical in RS image processing. To address these problems, a novel sparse representation-based framework for small-sample-size RS scene classification with deep feature fusion is proposed. Specially, multilevel features are first extracted from different layers of CNNs to fully exploit the feature learning ability of CNNs. Note that the existing well-trained CNNs, e.g., AlexNet, VGGNet, and ResNet50, are used for feature extraction, in which no labeled samples is required. Then, sparse representation-based classification is designed to fuse the multilevel features, which is especially effective when only a small number of training samples are available. Experimental results over two benchmark datasets, e.g., UC-Merced and WHU-RS19, demonstrated that the proposed method can effectively fuse different levels of features learned in CNNs, and clearly outperform several state-of-the-art methods especially with limited training samples.

Learning Sparse Features In Convolutional Neural Networks For Image Classification

Research on Image Classification Method of Features of Combinatorial Convolution

Robust Neighborhood Preserving Low-Rank Sparse CNN Features for Classification.

Remote Sensing Scene Classification Using Sparse Representation-Based Framework with Deep Feature Fusion

Learning Deep Representations Using Convolutional Auto-Encoders with Symmetric Skip Connections

Feature Sparsity in Convolutional Neural Networks for Scene Classification of Remote Sensing Image.

SparseNet: A Sparse DenseNet for Image Classification

Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network Features

Learning Sparse Features with Lightweight ScatterNet for Small Sample Training

Very Deep Convolutional Neural Network Based Image Classification Using Small Training Sample Size.

A Convolutional Neural Network with Sparse Representation

Low-rank sparse feature selection for image classification

Deep convolution neural network learning based on deconvolution feature extraction

Feature Ensemble Learning Based on Sparse Autoencoders for Image Classification

Revisiting Sparse Convolutional Model for Visual Recognition

Bio-Inspired Deep Spiking Neural Network For Image Classification

Simple convolutional neural network on image classification

Sparse-based Neural Response for Image Classification

Convolutional Neural Network Denoising Method Based on Multisize Features

Small-scale Convolutional Neural Networks with Learnable Gabor Filter for Image Classifications

LST-Net: Learning a Convolutional Neural Network with a Learnable Sparse Transform