Abstract:High resolution and strong semantic representation are both vital for feature extraction networks of pedestrian detection. The existing high-resolution network (HRNet) has presented a promising performance for pedestrian detection. However, we observed that it still has some significant shortcomings for heavily occluded and small-scale pedestrians. In this paper, we propose to address the shortcomings by extracting semantic and spatial context from HRNet. Specifically, we propose a Context-aware Feature Representation Learning Module (CFRL-Module), which combines a Multi-scale Feature Context Extraction Parallel Block for Convolution and Self-attention (CEPCA-Block) with two parallel paths and an Equivalent FFN (EFFN) Block. The core CEPCA-Block adopts a parallel design to integrate convolution and multi-head self-attention (MHSA) with low parameter computational cost, which can obtain the deep semantic context by convolution path and precise context by MHSA path. Furthermore, to overcome the inefficiency of global MHSA in high-resolution pedestrian detection, we propose a novel local window MHSA, which can significantly reduce memory consumption but barely affect the detection performance. Cascading the proposed CFRL-Module with the anchor-free detection head constitutes our Context-aware Feature Representation Learning Anchor-Free Network (CFRLA-Net). The proposed CFRLA-Net can catch a high-level understanding of the heavily occluded and small-scale pedestrian instances based on HRNet, which can effectively solve the limitation of the insufficient feature extraction ability of HRNet for the hard samples. Experimental results show that CFRLA-Net achieves state-of-the-art performance on CityPersons, Caltech, and CrowdHuman benchmarks.

Occluded Pedestrian Attention Network : an Occluded Pedestrian Detector

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

Mask-Guided Attention Network for Occluded Pedestrian Detection

Guided Attention in CNNs for Occluded Pedestrian Detection and Re-identification

See Extensively While Focusing on the Core Area for Pedestrian Detection.

Pedestrian Partial Occlusion Detection Method Based on Improved YOLO Network Structure

Attention-Guided Sample-Based Feature Enhancement Network for Crowded Pedestrian Detection Using Vision Sensors

Key points and visible part fusion attention network for occluded pedestrian detection in traffic environments

PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes

Dual-branch Self-Attention Network for Pedestrian Attribute Recognition

PSC-Net: learning part spatial co-occurrence for occluded pedestrian detection

Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Attention-Guided Region Proposal Network for Pedestrian Detection

Combined attention mechanism and CenterNet pedestrian detection algorithm

A Pedestrian Target Detection Network Based on Attention Mechanism and Multi-scale Feature Fusion

SARNet: Spatial Attention Residual Network for pedestrian and vehicle detection in large scenes

Feature Calibration Network for Occluded Pedestrian Detection

CFRLA-Net: A Context-aware Feature Representation Learning Anchor-free Network for Pedestrian Detection

A Lightweight Vehicle-Pedestrian Detection Algorithm Based on Attention Mechanism in Traffic Scenarios

Pedestrian Detection via Body Part Semantic and Contextual Information With DNN