Abstract:In this paper, an improved detector MRTMDet, is proposed to overcome the complex backgrounds noise and large scale‐variations challenge for oriented object detection in remote sensing images by designing innovative feature extraction network and feature fusion network. These networks integrate a lightweight vision transformer and a multi‐scale feature extraction module in different structures, thereby enhancing the overall quality of feature representation and the effectiveness in understanding and predicting tasks and further augmenting the model's ability to perceive both global features and multi‐scale features. The authors set the ablation and comparison experiments on the publicly available dataset DIOR‐R which show the model achieves excellent comprehensive performance and is well‐balanced with precision and lightweight. Object detection in remote sensing images aims to interpret images to obtain information on the category and location of potential targets, which is of great importance in traffic detection, marine supervision, and space reconnaissance. However, the complex backgrounds and large scale variations in remote sensing images present significant challenges. Traditional methods relied mainly on image filtering or feature descriptor methods to extract features, resulting in underperformance. Deep learning methods, especially one‐stage detectors, for example, the Real‐Time Object Detector (RTMDet) offers advanced solutions with efficient network architectures. Nevertheless, difficulty in feature extraction from complex backgrounds and target localisation in scale variations images limits detection accuracy. In this paper, an improved detector based on RTMDet, called the Multi‐Scale Feature Extraction‐assist RTMDet (MRTMDet), is proposed which address limitations through enhancement feature extraction and fusion networks. At the core of MRTMDet is a new backbone network MobileViT++ and a feature fusion network SFC‐FPN, which enhances the model's ability to capture global and multi‐scale features by carefully designing a hybrid feature processing unit of CNN and a transformer based on vision transformer (ViT) and poly‐scale convolution (PSConv), respectively. The experiment in DIOR‐R demonstrated that MRTMDet achieves competitive performance of 62.2% mAP, balancing precision with a lightweight design.

Multi-scale and Multi-dimensional Weighted Network for Salient Object Detection in Optical Remote Sensing Images

Multiscale and Multidimensional Weighted Network for Salient Object Detection in Optical Remote Sensing Images

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

Multi-scale Feature Aggregation Network for Salient Object Detection in Optical Remote Sensing Images

Multiscale Feature Enhancement Network for Salient Object Detection in Optical Remote Sensing Images

Multilevel Interactive Reverse-Guided Network for Salient Object Detection in Optical Remote Sensing Images

Localization, balance and affinity: a stronger multifaceted collaborative salient object detector in remote sensing images

Cross-Modal Weighting Network for RGB-D Salient Object Detection

Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images

Lightweight Salient Object Detection in Optical Remote-Sensing Images Via Semantic Matching and Edge Alignment

Dual-Stream Feature Collaboration Perception Network for Salient Object Detection in Remote Sensing Images

Unified Information Fusion Network for Multi-Modal RGB-D and RGB-T Salient Object Detection

ORSI Salient Object Detection Via Cross-Scale Interaction and Enlarged Receptive Field.

Edge-Aware Multiscale Feature Integration Network for Salient Object Detection in Optical Remote Sensing Images

Semantic-Guided Attention Refinement Network for Salient Object Detection in Optical Remote Sensing Images

SLMSF-Net: A Semantic Localization and Multi-Scale Fusion Network for RGB-D Salient Object Detection

MMNet: Multi-Stage and Multi-Scale Fusion Network for RGB-D Salient Object Detection

SFSANet: Multiscale Object Detection in Remote Sensing Image Based on Semantic Fusion and Scale Adaptability

Multi‐scale feature extraction for energy‐efficient object detection in remote sensing images

SSN: Scale Selection Network for Multi-Scale Object Detection in Remote Sensing Images

Multi-Content Complementation Network for Salient Object Detection in Optical Remote Sensing Images