Abstract:The detection performance in crowd scenes is limited by recalling hard objects (e.g., occluded objects). It requires that this kind of objects can be successfully detected and retained by the non-maximum suppression (NMS) while controlling false positives. The existing dynamic label assignment algorithms can help recall these objects by adaptively allocating appropriate positive samples, however, they ignore the alignment with the selecting rules of NMS. This leads to the fact that detecting objects in crowd scenes are still very sensitive to the NMS threshold setting. As a result, the existing methods can only set a low NMS threshold to avoid the excessive false positives, causing some objects failed to be recalled. And these methods also generally lack more excitation for positive samples, which hinders further facilitating the recall of hard instances in crowd scenes. This paper proposes a novel dynamic label assignment strategy for object detection in crowd scenes, called non-maximum suppression guided label assignment (NGLA), which aligns the assignment strategy with NMS process and learns more prominent positive samples. Following NMS, NGLA introduces the IoU between samples with their corresponding best samples to define positive and negative samples. To cooperate with NGLA, an NMS-aware loss is proposed to dynamically assign sample weights when supervising sample predictions, which also considers the IoU with the best sample. In addition, for better classification prediction, a regression assisted classification branch is designed to help detectors perceive the relation between the regression predictions of each sample and the corresponding best sample. Experiments demonstrate that NGLA outperforms other label assignment methods on CrowdHuman and Citypersons, and is less sensitive to the NMS threshold in crowd scenes.

Non-maximum Suppression Guided Label Assignment for Object Detection in Crowd Scenes

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

NMS-Loss: Learning with Non-Maximum Suppression for Crowded Pedestrian Detection

Instance-based Dynamic Label Assignment for Object Detection

Beyond Counting: Point Supervised Attention Guided Neural Network for Crowded Object Locating

A Novel Non-maximum Suppression Algorithm Based on Affinity Propagation Clustering.

Reconciling global and local optimal label assignments for heavily occluded pedestrian detection

CLAHR: Cascaded Label Assignment Head for High-Resolution Small Object Detection

Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes

A dynamic label assignment strategy for one-stage detectors

D-NMS: A Dynamic NMS Network for General Object Detection.

Object detection in crowded scenes via joint prediction

Sparse Label Assignment for Oriented Object Detection in Aerial Images

Reducing Spatial Labeling Redundancy for Semi-supervised Crowd Counting

Level-wise Dynamic Label Assignment for Oriented Object Detection.

Label Assignment Matters: A Gaussian Assignment Strategy for Tiny Object Detection

Cross-Grid Label Assignment for Arbitrary-Oriented Object Detection in Aerial Images

Detection Selection Algorithm: A Likelihood based Optimization Method to Perform Post Processing for Object Detection

RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detection

Adaptive Dynamic Label Assignment for Tiny Object Detection in Aerial Images

Graph Convolution And Self Attention Based Non-Maximum Suppression