Abstract:Object detection in aerial images has always been a challenging task due to the generally small size of the objects. Most current detectors prioritize novel detection frameworks, often overlooking research on fundamental components such as feature pyramid networks. In this paper, we introduce the Cross-Layer Feature Pyramid Transformer (CFPT), a novel upsampler-free feature pyramid network designed specifically for small object detection in aerial images. CFPT incorporates two meticulously designed attention blocks with linear computational complexity: the Cross-Layer Channel-Wise Attention (CCA) and the Cross-Layer Spatial-Wise Attention (CSA). CCA achieves cross-layer interaction by dividing channel-wise token groups to perceive cross-layer global information along the spatial dimension, while CSA completes cross-layer interaction by dividing spatial-wise token groups to perceive cross-layer global information along the channel dimension. By integrating these modules, CFPT enables cross-layer interaction in one step, thereby avoiding the semantic gap and information loss associated with element-wise summation and layer-by-layer transmission. Furthermore, CFPT incorporates global contextual information, which enhances detection performance for small objects. To further enhance location awareness during cross-layer interaction, we propose the Cross-Layer Consistent Relative Positional Encoding (CCPE) based on inter-layer mutual receptive fields. We evaluate the effectiveness of CFPT on two challenging object detection datasets in aerial images, namely VisDrone2019-DET and TinyPerson. Extensive experiments demonstrate the effectiveness of CFPT, which outperforms state-of-the-art feature pyramid networks while incurring lower computational costs. The code will be released at <a class="link-external link-https" href="https://github.com/duzw9311/CFPT" rel="external noopener nofollow">this https URL</a>.

Object Detection for Rotated and Densely Arranged Objects in Aerial Images Using Path Aggregated Feature Pyramid Networks

Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

Dense Multiscale Feature Fusion Pyramid Networks for Object Detection in UAV-Captured Images

Small object intelligent detection method based on adaptive recursive feature pyramid

A Two-Way Dense Feature Pyramid Networks for Object Detection of Remote Sensing Images

A multi-scale pyramid feature fusion-based object detection method for remote sensing images

Enhanced semantic feature pyramid network for small object detection

Info-FPN: An Informative Feature Pyramid Network for object detection in remote sensing images

Cross-Layer Feature Pyramid Transformer for Small Object Detection in Aerial Images

Incremental Detection of Remote Sensing Objects with Feature Pyramid and Knowledge Distillation

Dynamic Feature Pyramid Networks for Detection

Small object detection based on attention mechanism and enhanced network

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

An Efficient Feature Pyramid Network for Object Detection in Remote Sensing Imagery

Object Detection in Remote Sensing Images Based on a Scene-Contextual Feature Pyramid Network

UEFPN: Unified and Enhanced Feature Pyramid Networks for Small Object Detection

ARFP: A novel adaptive recursive feature pyramid for object detection in aerial images

Multi-Stage Feature Enhancement Pyramid Network for Detecting Objects in Optical Remote Sensing Images

Object Detection in Aerial Images Using Feature Fusion Deep Networks

Extended Feature Pyramid Network for Small Object Detection

ALFPN: Adaptive Learning Feature Pyramid Network for Small Object Detection