Abstract:Multiclass geospatial object detection in high-spatial-resolution remote-sensing images (HSRIs) has recently attracted considerable attention in many remote-sensing applications as a fundamental task. However, the complexity and uncertainty of spatial distribution among multiclass geospatial objects are still huge challenges for object detection in HSRIs. Most current remote-sensing object-detection approaches fall back on deep convolutional neural networks (CNNs). Nevertheless, most existing methods only focus on mining visual characteristics and lose sight of spatial or semantic relation discriminations, eventually degrading object-detection performance in HSRIs. To tackle these challenges, we propose a novel hybrid attention-driven multistream hierarchical graph embedding network (HA-MHGEN) to explore complementary spatial and semantic patterns for improving remote-sensing object-detection performance. Specifically, we first constructed hierarchical spatial graphs for multiscale spatial relation representation. Then, semantic graphs were also constructed by integrating them with the word embedding of object category labels on graph nodes. Afterwards, we developed a self-attention-aware multiscale graph convolutional network (GCN) to derive stronger for intra- and interobject hierarchical spatial relations and contextual semantic relations, respectively. These two relation networks were followed by a novel cross-attention-driven spatial- and semantic-feature fusion module that utilizes a multihead attention mechanism to learn associations between diverse spatial and semantic correlations, and guide them to endowing a more powerful discrimination ability. With the collaborative learning of the three relation networks, the proposed HA-MHGEN enables grasping explicit and implicit relations from spatial and semantic patterns, and boosts multiclass object-detection performance in HRSIs. Comprehensive and extensive experimental evaluation results on three benchmarks, namely, DOTA, DIOR, and NWPU VHR-10, demonstrate the effectiveness and superiority of our proposed method compared with that of other advanced remote-sensing object-detection methods.

Enhancing remote target classification in hyperspectral imaging using graph attention neural network

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

FPGA-based remote target classification in hyperspectral imaging using multi-graph neural network

Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Superpixel Feature Subdivision and Adaptive Graph Structure

Double-Branch Multilevel Skip Sparse Graph Attention Network for Hyperspectral Image Classification

PGNN-Net: Parallel Graph Neural Networks for Hyperspectral Image Classification Using Multiple Spatial-Spectral Features

ACGT-Net: Adaptive Cuckoo Refinement-Based Graph Transfer Network for Hyperspectral Image Classification

Cnn-assisted multi-hop graph attention network for hyperspectral image classification

Multi-scale Receptive Fields: Graph Attention Neural Network for Hyperspectral Image Classification

GACP: graph neural networks with ARMA filters and a parallel CNN for hyperspectral image classification

Adaptive Cross-Attention-Driven Spatial-Spectral Graph Convolutional Network for Hyperspectral Image Classification

Adaptive Sampling Toward a Dynamic Graph Convolutional Network for Hyperspectral Image Classification

Adaptive Cross-Attention-Driven Spatial–Spectral Graph Convolutional Network for Hyperspectral Image Classification

Semisupervised Classification for Hyperspectral Images Using Graph Attention Networks

A Novel Hybrid Attention-Driven Multistream Hierarchical Graph Embedding Network for Remote Sensing Object Detection

Graph Convolutional Network Using Adaptive Neighborhood Laplacian Matrix for Hyperspectral Images with Application to Rice Seed Image Classification

Spatial-Pooling-Based Graph Attention U-Net for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Fusion of Convolutional Neural Network and Graph Network

Graph Convolutional Networks for Hyperspectral Image Classification

Attention Graph Convolutional Network for Disjoint Hyperspectral Image Classification