Abstract:In the wake of developments in remote sensing, the application of target detection of remote sensing is of increasing interest. Unfortunately, unlike natural image processing, remote sensing image processing involves dealing with large variations in object size, which poses a great challenge to researchers. Although traditional multi-scale detection networks have been successful in solving problems with such large variations, they still have certain limitations: (1) The traditional multi-scale detection methods note the scale of features but ignore the correlation between feature levels. Each feature map is represented by a single layer of the backbone network, and the extracted features are not comprehensive enough. For example, the SSD network uses the features extracted from the backbone network at different scales directly for detection, resulting in the loss of a large amount of contextual information. (2) These methods combine with inherent backbone classification networks to perform detection tasks. RetinaNet is just a combination of the ResNet-101 classification network and FPN network to perform the detection tasks; however, there are differences in object classification and detection tasks. To address these issues, a cross-scale feature fusion pyramid network (CF2PN) is proposed. First and foremost, a cross-scale fusion module (CSFM) is introduced to extract sufficiently comprehensive semantic information from features for performing multi-scale fusion. Moreover, a feature pyramid for target detection utilizing thinning U-shaped modules (TUMs) performs the multi-level fusion of the features. Eventually, a focal loss in the prediction section is used to control the large number of negative samples generated during the feature fusion process. The new architecture of the network proposed in this paper is verified by DIOR and RSOD dataset. The experimental results show that the performance of this method is improved by 2–12% in the DIOR dataset and RSOD dataset compared with the current SOTA target detection methods.

CPN-based Multisensor Data Fusion for Target Classification

A Modified Cpn and Its Application in Data Fusion for Target Classification

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

Multi-Sensors Data Tracking Fusion Based on a Neural Network Filter

CF2PN: A Cross-Scale Feature Fusion Pyramid Network Based Remote Sensing Target Detection

Attention-based Fusion Factor in FPN for Object Detection

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Cascaded Multi-Channel Feature Fusion for Object Detection.

FusionCPP: Cooperative fusion of infrared and visible light images based on PCNN and PID control systems

Algorithm of Data Fusion Based on Neural Network Group

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

CFNet: A Cross Fusion Network for Joint Land Cover Classification Using Optical and SAR Images

An Adaptive PNN-DS Approach to Classification Using Multi-Sensor Information Fusion

Multilayer Feature Fusion Network With Spatial Attention and Gated Mechanism for Remote Sensing Scene Classification

MFFnet: Multimodal Feature Fusion Network for Synthetic Aperture Radar and Optical Image Land Cover Classification

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

Hierarchical Attention and Parallel Filter Fusion Network for Multisource Data Classification

Information Fusion for Classification of Hyperspectral and LiDAR Data Using IP-CNN

TCPSNet: Transformer and Cross-Pseudo-Siamese Learning Network for Classification of Multi-Source Remote Sensing Images