Abstract:The crowded scenario not only contains instances at various scales but also introduces a variety of occlusion patterns ranging from non-occluded situations to heavily occluded cases, making the shapes of the instances different. All of those can result in human detectors being hard to apply to them. Feature pyramid networks (FPN), as an indispensable part of generic object detectors, can significantly boost detection performance involving objects at different scales. As a result, in this paper, we equip FPN with a multi-scale feature fusion technology and attention mechanisms to improve the performance of human detection in crowded scenarios. Firstly, we designed a feature pyramid structure with a refined hierarchical-split block, referred to as Scale-FPN, which can better handle the challenging problem of scale variation across object instances. Secondly, an attention-based lateral connection (ALC) module with spatial and channel attention mechanisms was proposed to replace the lateral connection in the FPN, which enhances the representational ability of feature maps through rich spatial and semantic information and lets detectors be capable of focusing on important features of occlusion patterns. Additionally, a bottom-up path augmentation (BPA) module was adopted to exploit the features of the Scale-FPN and ALC modules. To verify the effectiveness of the proposed method, we combined Scale-FPN, ALC and BPA, namely SA-FPN, and integrated it into the architecture of a crowded human detector. Experiments on the challenging CrowdHuman benchmark sufficiently validate the effectiveness of SA-FPN. Specifically, it improves the state-of-the-art result of CrowdDet from 41.4% to 39.9% MR-2$$MR^{-2}$$, which indicates that the detector with SA-FPN brings in fewer false positives.

Fast Multi-scale fHOG Feature Extraction Using Histogram Downsampling

Fast Feature Pyramids for Object Detection

Multi-scale Convolution Target Detection Algorithm with Feature Pyramid

Fast Human Detection Based On Enhanced Variable Size Hog Features

Dynamic Feature Pyramid Networks for Detection

YOLOH: You Only Look One Hourglass for Real-Time Object Detection

Towards Better Object Detection in Scale Variation with Adaptive Feature Selection

Real-time human detection based on gentle MILBoost with variable granularity HOG-CSLBP

MGFPN: Enhancing Multi-Scale Feature for Object Detection

A novel fast combine-and-conquer object detector based on only one-level feature map

MM-FPN: Multi-path and Multi-scale Feature Pyramid Network for Object Detection

Multi-scale Feature Fusion with Point Pyramid for 3D Object Detection

Pedestrian Detection Optimization Algorithm Based on Low-Altitude UAV

Attentional feature pyramid network for small object detection

An Efficient HOG–ALBP Feature for Pedestrian Detection

ALFPN: Adaptive Learning Feature Pyramid Network for Small Object Detection

You Only Look One-level Feature

Extended Feature Pyramid Network for Small Object Detection

SA-FPN: An effective feature pyramid network for crowded human detection

Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method

Small Object Detection Algorithm Based on Feature Pyramid-Enhanced Fusion SSD