Abstract:Person search aims to simultaneously localize and identify a query person from uncropped images. To achieve this goal, state-of-the-art models typically add a re-id branch upon two-stage detectors like Faster R-CNN. Owing to the ROI-Align operation, this pipeline yields promising accuracy as re-id features are explicitly aligned with the corresponding object regions, but in the meantime, it introduces high computational overhead due to dense object anchors. In this work, we present an anchor-free approach to efficiently tackling this challenging task, by introducing the following dedicated designs. First, we select an anchor-free detector (i.e., FCOS) as the prototype of our framework. Due to the lack of dense object anchors, it exhibits significantly higher efficiency compared with existing person search models. Second, when directly accommodating this anchor-free detector for person search, there exist several misalignment issues in different levels (i.e., scale, region, and task). To address these issues, we propose an aligned feature aggregation module to generate more discriminative and robust feature embeddings. Accordingly, we name our framework as Feature-Aligned Person Search Network (AlignPS). Third, by investigating the advantages of both anchor-based and anchor-free models, we further augment AlignPS with an ROI-Align head, which significantly improves the robustness of re-id features while still keeping our model highly efficient. Our framework not only achieves state-of-the-art or competitive performance on two challenging person search benchmarks, but can be also extended to other challenging searching tasks such as animal and object search. All the source codes, data, and trained models are available at: https://github.com/daodaofr/alignps.

Structure-aware Person Search with Self-Attention and Online Instance Aggregation Matching

Hierarchical Online Instance Matching for Person Search

Unleashing the Feature Hierachy Potential: an Efficient Tri-Hybrid Person Search Model

Improved Instance Discrimination and Feature Compactness for End-to-End Person Search

Person Search by Separated Modeling and A Mask-Guided Two-Stream CNN Model

Person Search Via Anchor-Free Detection and Part-Based Group Feature Similarity Estimation

Person Search by Multi-Scale Matching

Decoupled and Memory-Reinforced Networks: Towards Effective Feature Learning for One-Step Person Search

Beyond the Parts: Learning Coarse-to-Fine Adaptive Alignment Representation for Person Search

A Cascaded Multitask Network With Deformable Spatial Transform On Person Search

Improving Person Search by Adaptive Feature Pyramid-based Multi-Scale Matching

Global-aware and Local-Aware Enhancement Network for Person Search.

Multi-Attribute Enhancement Network for Person Search

Person Search With Joint Detection, Segmentation And Re-Identification

Dynamic Imposter Based Online Instance Matching for Person Search

Efficient Person Search: an Anchor-Free Approach

Person Search via A Mask-Guided Two-Stream CNN Model

Joint Detection and Identification Feature Learning for Person Search

Learning adaptive shift and task decoupling for discriminative one-step person search

Person Search Based on Attention Mechanism.

Multilevel Collaborative Attention Network for Person Search