Abstract:With the development of self-driving technology, pedestrian detection models are becoming more useful and important. Although object detection models based on Convolutional Neural Networks have achieved favorable detection results, due to the occlusion in crowded scenarios, dense pedestrian detection is still a challenging task compared with generic object detection. For a CNN-based object detector, an appropriate label assignment method is significant. In this paper, we propose an effective training sample allocation method called Occlusion-Prediction aware Label Assignment (OPLA) to improve the performance of the detector in crowded scenarios. For those Ground Truths (GTs) without severe occlusion, we directly assign prediction boxes with the best matching quality as the corresponding positive samples. In terms of GTs in heavily crowded areas, we fine-tune the matching quality based on visible ratio to enhance the training sample selection priority of severe occluded GTs. In addition, we reveal the deficiency of currently popular post-processing algorithms, Non-Maximum Suppression (NMS) and Soft-NMS for dense pedestrian detection, and propose Hierarchical-NMS (H-NMS) whose strategy diverges with different Intersection over Union (IoU) levels. Experimental results on Crowdhuman, the largest dense pedestrian detection dataset at present, show our approach optimizes the Average Precision (AP) and Miss Rate (MR) of Fully Convolutional One Stage Object Detection (FCOS) by 4.05% and 5.35% and outperforms many state-of-the-art detectors, respectively. Besides, our method does not bring any increase in calculation during inference.

Msf-Acnn: Multi-Scale Feature Fusion Atrous Convolutional Neural Networks For Pedestrian Fine-Grained Attribution Detection

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Multi-scale cross-layer fusion and center position network for pedestrian detection

Fused DNN: A deep neural network fusion approach to fast and robust pedestrian detection

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

SAM-RCNN: Scale-Aware Multi-Resolution Multi-Channel Pedestrian Detection

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Asymmetric multi-stage CNNs for small-scale pedestrian detection

Multispectral Deep Neural Networks for Pedestrian Detection

3D Object Detection Based on Attention and Multi-Scale Feature Fusion

Pedestrian Detection with Multi-View Convolution Fusion Algorithm

Multi-Grained Deep Feature Learning for Pedestrian Detection

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

MSF-CSPNet: A Specially Designed Backbone Network for Faster R-CNN

Attribute Aware Pooling for Pedestrian Attribute Recognition

Deep Feature Fusion by Competitive Attention for Pedestrian Detection

A Vision Enhancement and Feature Fusion Multiscale Detection Network

Pushing the Limits of Deep CNNs for Pedestrian Detection

Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Improving Multispectral Pedestrian Detection with Scale‐aware Permutation Attention and Adjacent Feature Aggregation

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism