Abstract:The goals of object detection are to accurately detect and locate objects of various sizes in digital images. Multi-scale processing technology can improve the detection accuracy of the detector. Feature pyramid networks (FPNs) have been proven to be effective in extracting multi-scaled features. However, most existing object detection methods recognize objects in isolation, without considering contextual information between objects. Moreover, for the sake of computational efficiency, a significant reduction in the channel dimension may lead to the loss of semantic information. This study explores the utilization of attention mechanisms to augment the representational power and efficiency of features, ultimately improving the accuracy and efficiency of object detection. The study proposed a novel hierarchical attention feature pyramid network (HA-FPN), which comprises two key components: transformer feature pyramid networks (TFPNs) and channel attention modules (CAMs). In TFPNs, multi-scaled convolutional features are embedded as tokens and self-attention is applied to across both the intra- and inter-scales to capture contextual information between the tokens. CAMs are employed to select the channels with rich channel information to alleviate massive channel information losses. By introducing contextual information and attention mechanisms, the HA-FPN significantly improves the accuracy of bounding box detection, leading to more precise identification and localization of target objects. Extensive experiments conducted on the challenging MS COCO dataset demonstrate that the proposed HA-FPN outperforms existing multi-object detection models, while incurring minimal computational overhead.

An improved feature pyramid network for object detection

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

CB-FPN: object detection feature pyramid network based on context information and bidirectional efficient fusion

Attention-based Fusion Factor in FPN for Object Detection

A context- and level-aware feature pyramid network for object detection with attention mechanism

Dynamic Feature Pyramid Networks for Detection

MFPN: A Novel Mixture Feature Pyramid Network of Multiple Architectures for Object Detection

Complementary Feature Pyramid Network for Object Detection

Bidirectional Parallel Feature Pyramid Network for Object Detection

Dynamic Feature Pyramid Networks for Object Detection

Cascaded Multi-Channel Feature Fusion for Object Detection.

Content-Augmented Feature Pyramid Network with Light Linear Spatial Transformers for Object Detection

AFPN: Asymptotic Feature Pyramid Network for Object Detection

Enhanced semantic feature pyramid network for small object detection

Parallel Residual Bi-Fusion Feature Pyramid Network for Accurate Single-Shot Object Detection

A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection

A feature pyramid network with adaptive fusion strategy and enhanced semantic information

HA-FPN: Hierarchical Attention Feature Pyramid Network for Object Detection

Residual Bi-Fusion Feature Pyramid Network for Accurate Single-shot Object Detection

An attention-based feature pyramid network for single-stage small object detection

RCNet: Reverse Feature Pyramid and Cross-scale Shift Network for Object Detection