Abstract:Group re-identification (GReID) aims to correctly associate images containing the same group members captured with non-overlapping camera networks, which has important applications in video surveillance. Unlike the person re-identification, the unique challenge of GReID lies in variations of group structure, including the number and layout of members. Current methods use certainty modeling, in which the specific group structure presented in each image is considered. However, certainty modeling can only describe finite group structures and shows poor generalization for unseen group structures, i.e., group variations that do not exist in the training set. In this paper, we propose a methodology called uncertainty modeling, which excavates near-infinite group structures from finite samples by simulating variations in both number and layout. Specifically, member uncertainty treats the number of intra-group members as a truncated Gaussian distribution instead of a fixed value and then simulates member variations by dynamic sampling. Layout uncertainty constructs random affine transformations about the positions of members to enlarge the fixed schemes in the training set. To implement the proposed methodology, we technically propose an U ncertainty- M odeling S econd- O rder T ransformer (UMSOT) that extracts a first-order token for each member and further uses these tokens to learn a second-order token as a group feature. The UMSOT exploits the structural advantages of the transformer to explicitly extract layout features and efficiently integrate appearance and layout features, which are hardly achievable by current CNN- and GNN-based methods. Comprehensive experiments on four datasets (CSG, SYSUGroup, RoadGroup, and iLIDS-MCTS), fully demonstrate the superiority of the proposed method, which surprisingly outperforms the state-of-the-art method by 30.4% in Rank1 on the CSG dataset. https://github.com/LinlyAC/UMSOT.

Group Re-Identification: Leveraging and Integrating Multi-Grain Information.

Group Reidentification with Multigrained Matching and Integration.

The Research of Group Re-identification from Multiple Cameras

Contribution-Based Multi-Stream Feature Distance Fusion Method with ${k}$ -Distribution Re-Ranking for Person Re-Identification

Contribution-Based Multi-Stream Feature Distance Fusion Method With <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-Distribution Re-Ranking for Person Re-Identification

Person Re-Identification Using Group Constraint

Learning Multi-Attention Context Graph for Group-Based Re-Identification

Patch-based Camera-Aware Person-to-group Learning and Group Similarity Strategy for Unsupervised Group Re-Identification

Person Re-identification by Multi-hypergraph Fusion

People Re-Identification with Local Distance Comparison Using Learned Metric.

Hierarchical Multi-Graphs Learning for Robust Group Re-Identification

Group Re-Identification via Transferred Representation and Adaptive Fusion

Person Re-Identification by Weighted Integration of Sparse and Collaborative Representation.

Group Association: Assisting Re-Identification by Visual Context

Multi-granular inter-frame relation exploration and global residual embedding for video-based person re-identification

Multitask Multigranularity Aggregation With Global-Guided Attention for Video Person Re-Identification

Uncertainty Modeling for Group Re-Identification

Person Re-identification Across Multiple Non-overlapping Cameras by Grouping Similarity Comparison Model

Siamese Transformer for Group Re-Identification Via Multiscale Feature Transform and Joint Learning

Learning Adaptive Progressive Representation for Group Re-identification.

Group Re-Identification With Hybrid Attention Model And Residual Distance