Abstract:Person search aims to simultaneously localize and identify a query person from uncropped images. To achieve this goal, state-of-the-art models typically add a re-id branch upon two-stage detectors like Faster R-CNN. Owing to the ROI-Align operation, this pipeline yields promising accuracy as re-id features are explicitly aligned with the corresponding object regions, but in the meantime, it introduces high computational overhead due to dense object anchors. In this work, we present an anchor-free approach to efficiently tackling this challenging task, by introducing the following dedicated designs. First, we select an anchor-free detector (i.e., FCOS) as the prototype of our framework. Due to the lack of dense object anchors, it exhibits significantly higher efficiency compared with existing person search models. Second, when directly accommodating this anchor-free detector for person search, there exist several misalignment issues in different levels (i.e., scale, region, and task). To address these issues, we propose an aligned feature aggregation module to generate more discriminative and robust feature embeddings. Accordingly, we name our framework as Feature-Aligned Person Search Network (AlignPS). Third, by investigating the advantages of both anchor-based and anchor-free models, we further augment AlignPS with an ROI-Align head, which significantly improves the robustness of re-id features while still keeping our model highly efficient. Our framework not only achieves state-of-the-art or competitive performance on two challenging person search benchmarks, but can be also extended to other challenging searching tasks such as animal and object search. All the source codes, data, and trained models are available at: https://github.com/daodaofr/alignps.

Person Search Via Anchor-Free Detection and Part-Based Group Feature Similarity Estimation

Unleashing the Feature Hierachy Potential: an Efficient Tri-Hybrid Person Search Model

Beyond the Parts: Learning Coarse-to-Fine Adaptive Alignment Representation for Person Search

Improving Person Search by Adaptive Feature Pyramid-based Multi-Scale Matching

Improved Instance Discrimination and Feature Compactness for End-to-End Person Search

Attentive Multi-Granularity Perception Network for Person Search

Multilevel Collaborative Attention Network for Person Search

Segmentation Mask Guided End-to-End Person Search

A Cascaded Multitask Network With Deformable Spatial Transform On Person Search

Structure-aware Person Search with Self-Attention and Online Instance Aggregation Matching

Person Search by Separated Modeling and A Mask-Guided Two-Stream CNN Model

Decoupled and Memory-Reinforced Networks: Towards Effective Feature Learning for One-Step Person Search

Spatial Invariant Person Search Network.

GAN-based Person Search Via Deep Complementary Classifier with Center-Constrained Triplet Loss

Person Search via A Mask-Guided Two-Stream CNN Model

Hierarchical Gumbel Attention Network for Text-based Person Search

Efficient Person Search: an Anchor-Free Approach

DMRNet++: Learning Discriminative Features with Decoupled Networks and Enriched Pairs for One-Step Person Search

Learning Scene-Pedestrian Graph for End-to-End Person Search

GPAN-PS: Global-Response Pedestrian Attention Network for End-to-End Person Search

Robust Partial Matching for Person Search in the Wild