Abstract:Multiclass geospatial object detection in high-spatial-resolution remote-sensing images (HSRIs) has recently attracted considerable attention in many remote-sensing applications as a fundamental task. However, the complexity and uncertainty of spatial distribution among multiclass geospatial objects are still huge challenges for object detection in HSRIs. Most current remote-sensing object-detection approaches fall back on deep convolutional neural networks (CNNs). Nevertheless, most existing methods only focus on mining visual characteristics and lose sight of spatial or semantic relation discriminations, eventually degrading object-detection performance in HSRIs. To tackle these challenges, we propose a novel hybrid attention-driven multistream hierarchical graph embedding network (HA-MHGEN) to explore complementary spatial and semantic patterns for improving remote-sensing object-detection performance. Specifically, we first constructed hierarchical spatial graphs for multiscale spatial relation representation. Then, semantic graphs were also constructed by integrating them with the word embedding of object category labels on graph nodes. Afterwards, we developed a self-attention-aware multiscale graph convolutional network (GCN) to derive stronger for intra- and interobject hierarchical spatial relations and contextual semantic relations, respectively. These two relation networks were followed by a novel cross-attention-driven spatial- and semantic-feature fusion module that utilizes a multihead attention mechanism to learn associations between diverse spatial and semantic correlations, and guide them to endowing a more powerful discrimination ability. With the collaborative learning of the three relation networks, the proposed HA-MHGEN enables grasping explicit and implicit relations from spatial and semantic patterns, and boosts multiclass object-detection performance in HRSIs. Comprehensive and extensive experimental evaluation results on three benchmarks, namely, DOTA, DIOR, and NWPU VHR-10, demonstrate the effectiveness and superiority of our proposed method compared with that of other advanced remote-sensing object-detection methods.

HAR-Net: Joint Learning of Hybrid Attention for Single-Stage Object Detection

MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection

Decoupled Self Attention for Accurate One Stage Object Detection.

Object detection based on an adaptive attention mechanism

Single-Shot Object Detector Based on Attention Mechanism.

EBiDA-FPN: Enhanced Bi-Directional Attention Feature Pyramid Network for Object Detection

HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification

HCNET: A Point Cloud Object Detection Network Based on Height and Channel Attention

Multi-scale coupled attention for visual object detection

Attention CoupleNet: Fully Convolutional Attention Coupling Network for Object Detection

Rethinking Attentive Object Detection Via Neural Attention Learning.

Learning Synergistic Attention for Light Field Salient Object Detection

A Novel Hybrid Attention-Driven Multistream Hierarchical Graph Embedding Network for Remote Sensing Object Detection

Hybrid Feature Aligned Network for Salient Object Detection in Optical Remote Sensing Imagery

Single-Stage Detector With Dual Feature Alignment for Remote Sensing Object Detection

Object Detection Based on RetinaNet+CBAM Attention Mechanism

Mutual-Assistance Learning for Object Detection.

ACSTNet: An Attention Cross Stage Transformers Network for Small Object Detection in Remote Sensing Images

Attention-Enhanced and More Balanced R-CNN for Object Detection

TGADHead: an Efficient and Accurate Task-Guided Attention-Decoupled Head for Single-Stage Object Detection

An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images