Abstract:With the continuous improvement of satellite sensor performance, it is becoming easier to obtain different types of remote sensing (RS) data from multiple sensors, and the fusion of hyperspectral (HS) images and light detection and ranging (LiDAR) for land use/land cover (LULC) classification has become a research hotspot. However, the current mainstream methods still have defects in feature extraction and feature fusion. In the feature extraction stage, previous methods usually use a single-scale patch as input and a fixed convolution kernel for feature extraction, which makes it difficult to extract features in line with different land cover types at the same time and to obtain high-quality features. Although multiscale feature extraction can solve the one-sidedness problem of single-scale features, it also brings the challenge of high-dimensional multiscale features. In the feature fusion stage, the current fusion methods are relatively simple. Therefore, we propose a dynamic scale hierarchical fusion network (DSHFNet) for fusion classification of HS images and LiDAR data. By calculating the similarity in the scale space and judging the information at different scales through the threshold value, the appropriate scale features are dynamically selected, the small-scale features are integrated into the large-scale features, and the dimensionality of the features is reduced. This method solves the unreliability problem of single-scale features and the high-dimensional problem of multiscale features. In the feature fusion process, different attention modules are used for hierarchical fusion, spatial attention modules are used for shallow fusion and joint feature extraction, and modal attention modules are used for deep fusion of joint features and features from different sensors to achieve complete complementarity of features. Experimental evaluations on three real RS datasets demonstrate the superiority of the proposed method compared with existing methods. The source code can be downloaded at https://github.com/SYFYN0317/DSHFNet .

Multi-attentive Hierarchical Dense Fusion Net for Fusion Classification of Hyperspectral and LiDAR Data

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

DSHFNet: Dynamic Scale Hierarchical Fusion Network Based on Multiattention for Hyperspectral Image and LiDAR Data Classification

Multilevel Attention Dynamic-Scale Network for HSI and LiDAR Data Fusion Classification

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

Multiple Information Collaborative Fusion Network for Joint Classification of Hyperspectral and LiDAR Data

Multibranch Feature Fusion Network with Self- and Cross-Guided Attention for Hyperspectral and LiDAR Classification

HI2D2FNet: Hyperspectral Intrinsic Image Decomposition Guided Data Fusion Network for Hyperspectral and LiDAR Classification

Multi-Scale Feature Fusion for Hyperspectral and Lidar Data Joint Classification

Hyperspectral Image Classification With Multiattention Fusion Network

A Hierarchical Coarse–Fine Adaptive Fusion Network for the Joint Classification of Hyperspectral and LiDAR Data

Joint Classification of Hyperspectral and LiDAR Data Based on Heterogeneous Attention Feature Fusion Network

MSLAENet: Multiscale Learning and Attention Enhancement Network for Fusion Classification of Hyperspectral and LiDAR Data

A Novel Adaptive Hybrid Fusion Network for Multiresolution Remote Sensing Images Classification

Joint Classification of Hyperspectral and LiDAR Data Using Height Information Guided Hierarchical Fusion-and-Separation Network

AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network

Joint Classification of Hyperspectral and Lidar Data Using Cross-Modal Hierarchical Frequency Fusion Network

Attention Fusion of Transformer-Based and Scale-Based Method for Hyperspectral and LiDAR Joint Classification

Hierarchical Attention and Parallel Filter Fusion Network for Multi-Source Data Classification

AM³Net: Adaptive Mutual-Learning-Based Multimodal Data Fusion Network