Abstract:Multiclass geospatial object detection in high-spatial-resolution remote-sensing images (HSRIs) has recently attracted considerable attention in many remote-sensing applications as a fundamental task. However, the complexity and uncertainty of spatial distribution among multiclass geospatial objects are still huge challenges for object detection in HSRIs. Most current remote-sensing object-detection approaches fall back on deep convolutional neural networks (CNNs). Nevertheless, most existing methods only focus on mining visual characteristics and lose sight of spatial or semantic relation discriminations, eventually degrading object-detection performance in HSRIs. To tackle these challenges, we propose a novel hybrid attention-driven multistream hierarchical graph embedding network (HA-MHGEN) to explore complementary spatial and semantic patterns for improving remote-sensing object-detection performance. Specifically, we first constructed hierarchical spatial graphs for multiscale spatial relation representation. Then, semantic graphs were also constructed by integrating them with the word embedding of object category labels on graph nodes. Afterwards, we developed a self-attention-aware multiscale graph convolutional network (GCN) to derive stronger for intra- and interobject hierarchical spatial relations and contextual semantic relations, respectively. These two relation networks were followed by a novel cross-attention-driven spatial- and semantic-feature fusion module that utilizes a multihead attention mechanism to learn associations between diverse spatial and semantic correlations, and guide them to endowing a more powerful discrimination ability. With the collaborative learning of the three relation networks, the proposed HA-MHGEN enables grasping explicit and implicit relations from spatial and semantic patterns, and boosts multiclass object-detection performance in HRSIs. Comprehensive and extensive experimental evaluation results on three benchmarks, namely, DOTA, DIOR, and NWPU VHR-10, demonstrate the effectiveness and superiority of our proposed method compared with that of other advanced remote-sensing object-detection methods.

CDD-Net: A Context-Driven Detection Network for Multiclass Object Detection

CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery

Multi-Class Object Detection in Remote Sensing Image Based On Context information and Regularized Convolutional Network

A Contextual Deep Neural Network with Dilated Convolutions for Object Detection in Remote Sensing Images

Multi-Class Objects Detection Method in Remote Sensing Image Based on Direct Feedback Control for Convolutional Neural Network

CABDet: context-and-attention-based detector for small object detection in remote sensing images

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

Adaptive adjacent context negotiation network for object detection in remote sensing imagery

GCWNet: A Global Context-Weaving Network for Object Detection in Remote Sensing Images

Dynamic Feature and Context Enhancement Network for Faster Detection of Small Objects

TCANet: Triple Context-Aware Network for Weakly Supervised Object Detection in Remote Sensing Images

LGCNet: A Local-to-global Context-Aware Feature Augmentation Network for Salient Object Detection

CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote-Sensing Images

A fast self-attention cascaded network for object detection in large scene remote sensing images

YOLO-DCTI: Small Object Detection in Remote Sensing Base on Contextual Transformer Enhancement

Improving 3D Object Detection with Context-Aware and Dimensional Interaction Attention

Structured Object-Level Relational Reasoning CNN-Based Target Detection Algorithm in a Remote Sensing Image

A Deep Neural Network Combined With Context Features for Remote Sensing Scene Classification

Feature Enhancement Network for Object Detection in Optical Remote Sensing Images

An Effective and Lightweight Hybrid Network for Object Detection in Remote Sensing Images

A Novel Hybrid Attention-Driven Multistream Hierarchical Graph Embedding Network for Remote Sensing Object Detection