Abstract:With more detailed spatial information being represented in very-high-resolution (VHR) remote sensing images, stringent requirements are imposed on accurate image classification. Due to the diverse land objects with intraclass variation and interclass similarity, efficient and fine classification of VHR images especially in complex scenes are challenging. Even for some popular deep learning (DL) frameworks, geometric details of land objects may be lost in deep feature levels, so it is difficult to maintain the highly detailed spatial information (e.g., edges, small objects) only relying on the last high-level layer. Moreover, many of the newly developed DL methods require massive well-labeled samples, which inevitably deteriorates the model generalization ability under the few-shot learning. Therefore, in this article, a lightweight shallow-to-deep feature fusion network (SDF 2 N) is proposed for VHR image classification, where the traditional machine learning (ML) and DL schemes are integrated to learn rich and representative information to improve the classification accuracy. In particular, the shallow spectral–spatial features are first extracted and then a novel triple-stage fusion (TSF) module is designed to learn the saliency and discriminative information at different levels for classification. The TSF module includes three feature fusion stages, that is, low-level spectral–spatial feature fusion, middle-level multiscale feature fusion, and high-level multilayer feature fusion. The proposed SDF 2 N takes the advantage of the shallow-to-deep features, which can extract representative and complementary information from crossing layers. It is important to note that even with limited training samples, the SDF 2 N still can achieve satisfying classification performance. Experimental results obtained on three real VHR remote sensing datasets including two multispectral and one airborne hyperspectral - mages covering complex urban scenarios confirm the effectiveness of the proposed approach compared with the state-of-the-art methods.

Deep Fusion of Hyperspectral and LiDAR Data for Thematic Classification.

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Deep Feature Fusion for High-Resolution Aerial Scene Classification

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Dense Connectivity Based Two-Stream Deep Feature Fusion Framework for Aerial Scene Classification

Classification of Hyperspectral and LiDAR Data Using Coupled CNNs

A Shallow-to-Deep Feature Fusion Network for VHR Remote Sensing Image Classification

A dual-branch multi-feature deep fusion network framework for hyperspectral image classification

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification

Dual-Branch Feature Fusion Network Based Cross-Modal Enhanced CNN and Transformer for Hyperspectral and LiDAR Classification

Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification

Feature Fusion via Deep Residual Graph Convolutional Network for Hyperspectral Image Classification

Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks

Lightweight Multilevel Feature Fusion Network for Hyperspectral Image Classification

Information Fusion for Classification of Hyperspectral and LiDAR Data Using IP-CNN

Three-branch attention deep model for hyperspectral image classification using cross fusion

A Joint Convolutional Cross ViT Network for Hyperspectral and Light Detection and Ranging Fusion Classification

Joint Classification of Hyperspectral and LiDAR Data Using Height Information Guided Hierarchical Fusion-and-Separation Network

Multiscale Feature Fusion Network Incorporating 3D Self-Attention for Hyperspectral Image Classification