Abstract:Deep neural networks (DNNs) face many problems in the very high resolution remote sensing (VHRRS) per-pixel classification field. Among the problems is the fact that as the depth of the network increases, gradient disappearance influences classification accuracy and the corresponding increasing number of parameters to be learned increases the possibility of overfitting, especially when only a small amount of VHRRS labeled samples are acquired for training. Further, the hidden layers in DNNs are not transparent enough, which results in extracted features not being sufficiently discriminative and significant amounts of redundancy. This paper proposes a novel depth-width-reinforced DNN that solves these problems to produce better per-pixel classification results in VHRRS. In the proposed method, densely connected neural networks and internal classifiers are combined to build a deeper network and balance the network depth and performance. This strengthens the gradients, decreases negative effects from gradient disappearance as the network depth increases and enhances the transparency of hidden layers, making extracted features more discriminative and reducing the risk of overfitting. In addition, the proposed method uses multi-scale filters to create a wider neural network. The depth of the filters from each scale is controlled to decrease redundancy and the multi-scale filters enable utilization of joint spatio-spectral information and diverse local spatial structure simultaneously. Furthermore, the concept of network in network is applied to better fuse the deeper and wider designs, making the network operate more smoothly. The results of experiments conducted on BJ02, GF02, geoeye and quickbird satellite images verify the efficacy of the proposed method. The proposed method not only achieves competitive classification results but also proves that the network can continue to be robust and perform well even while the amount of labeled training samples is decreasing, which fits the small training samples situation faced by VHRRS per-pixel classification.

Densely Connected Neural Networks for Nonlinear Regression

RegHD: Robust and Efficient Regression in Hyper-Dimensional Learning System

Deep Residual Learning for Nonlinear Regression

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Spiking Deep Residual Networks.

Convolutional Networks with Dense Connectivity

Face Recognition Based on Densely Connected Convolutional Networks

Nonlinear Regression via Deep Negative Correlation Learning

> ? ∗ > 0 B ? ∗ > 0 C ? ∗ > 0 DEC Conv = Full-image Encoder Conv Conv Conv Conv Conv Conv Convs ASPP # Dense Feature Extractor Scene Understanding Modular Ordinal Regression Input Output

Image classification based on tensor network DenseNet model

DenseNet-Based Depth-Width Double Reinforced Deep Learning Neural Network for High-Resolution Remote Sensing Image Per-Pixel Classification

Robust Regression Via Deep Negative Correlation Learning

Hierarchical Deep Neural Network for Multivariate Regression

Dense ReLU Neural Networks for Temporal-spatial Model

Image Superresolution Using Densely Connected Residual Networks

When Residual Learning Meets Dense Aggregation: Rethinking the Aggregation of Deep Neural Networks

Comparative investigation on dimension reduction and regression in three layer feed-forward neural network

Deep Ordinal Regression Network for Monocular Depth Estimation

S-DenseNet: A DenseNet Compression Model Based on Convolution Grouping Strategy Using Skyline Method.