Abstract:High resolution and strong semantic representation are both vital for feature extraction networks of pedestrian detection. The existing high-resolution network (HRNet) has presented a promising performance for pedestrian detection. However, we observed that it still has some significant shortcomings for heavily occluded and small-scale pedestrians. In this paper, we propose to address the shortcomings by extracting semantic and spatial context from HRNet. Specifically, we propose a Context-aware Feature Representation Learning Module (CFRL-Module), which combines a Multi-scale Feature Context Extraction Parallel Block for Convolution and Self-attention (CEPCA-Block) with two parallel paths and an Equivalent FFN (EFFN) Block. The core CEPCA-Block adopts a parallel design to integrate convolution and multi-head self-attention (MHSA) with low parameter computational cost, which can obtain the deep semantic context by convolution path and precise context by MHSA path. Furthermore, to overcome the inefficiency of global MHSA in high-resolution pedestrian detection, we propose a novel local window MHSA, which can significantly reduce memory consumption but barely affect the detection performance. Cascading the proposed CFRL-Module with the anchor-free detection head constitutes our Context-aware Feature Representation Learning Anchor-Free Network (CFRLA-Net). The proposed CFRLA-Net can catch a high-level understanding of the heavily occluded and small-scale pedestrian instances based on HRNet, which can effectively solve the limitation of the insufficient feature extraction ability of HRNet for the hard samples. Experimental results show that CFRLA-Net achieves state-of-the-art performance on CityPersons, Caltech, and CrowdHuman benchmarks.

CAPNet: Context and Attribute Perception for Pedestrian Detection

See Extensively While Focusing on the Core Area for Pedestrian Detection.

Convergence and Divergence: A New Paradigm for Pedestrian Detection

CFRLA-Net: A Context-aware Feature Representation Learning Anchor-free Network for Pedestrian Detection

Improved SENet for Pedestrian Detection

Dual-branch Self-Attention Network for Pedestrian Attribute Recognition

Pedestrian As Points: an Improved Anchor-Free Method for Center-Based Pedestrian Detection.

PFEL-Net: A lightweight network to enhance feature for multi-scale pedestrian detection

Pedestrian Detection Algorithm Based on Multi-Scale Feature Extraction and Attention Feature Fusion

Multiscale Anchor-Free Region Proposal Network for Pedestrian Detection.

FE-CSP: a Fast and Efficient Pedestrian Detector with Center and Scale Prediction.

Learning Pixel-Level and Instance-Level Context-Aware Features for Pedestrian Detection in Crowds.

Attribute-Aware Pedestrian Detection in a Crowd

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

Attention-Guided Sample-Based Feature Enhancement Network for Crowded Pedestrian Detection Using Vision Sensors

Occluded Pedestrian Attention Network : an Occluded Pedestrian Detector

A Hybrid Self-Attention Model for Pedestrians Detection.

A Part-Aware Multi-Scale Fully Convolutional Network for Pedestrian Detection

Pedestrian Detection via Body Part Semantic and Contextual Information With DNN

Correlation-and-Correction Fusion Attention Network for Occluded Pedestrian Detection

MSAGNet: Multi-Stream Attribute-Guided Network for Occluded Pedestrian Detection