Abstract:Group re-identification (GReID) aims to correctly associate images containing the same group members captured with non-overlapping camera networks, which has important applications in video surveillance. Unlike the person re-identification, the unique challenge of GReID lies in variations of group structure, including the number and layout of members. Current methods use certainty modeling, in which the specific group structure presented in each image is considered. However, certainty modeling can only describe finite group structures and shows poor generalization for unseen group structures, i.e., group variations that do not exist in the training set. In this paper, we propose a methodology called uncertainty modeling, which excavates near-infinite group structures from finite samples by simulating variations in both number and layout. Specifically, member uncertainty treats the number of intra-group members as a truncated Gaussian distribution instead of a fixed value and then simulates member variations by dynamic sampling. Layout uncertainty constructs random affine transformations about the positions of members to enlarge the fixed schemes in the training set. To implement the proposed methodology, we technically propose an U ncertainty- M odeling S econd- O rder T ransformer (UMSOT) that extracts a first-order token for each member and further uses these tokens to learn a second-order token as a group feature. The UMSOT exploits the structural advantages of the transformer to explicitly extract layout features and efficiently integrate appearance and layout features, which are hardly achievable by current CNN- and GNN-based methods. Comprehensive experiments on four datasets (CSG, SYSUGroup, RoadGroup, and iLIDS-MCTS), fully demonstrate the superiority of the proposed method, which surprisingly outperforms the state-of-the-art method by 30.4% in Rank1 on the CSG dataset. https://github.com/LinlyAC/UMSOT.

Group Re-Identification with Group Context Graph Neural Networks

Learning Visual Context for Group Activity Recognition.

Learning Multi-Attention Context Graph for Group-Based Re-Identification

Hierarchical Multi-Graphs Learning for Robust Group Re-Identification

Context-Aware Graph Convolution Network for Target Re-identification.

Learning Adaptive Progressive Representation for Group Re-identification.

Group Reidentification with Multigrained Matching and Integration.

DoT-GNN

Group Re-Identification via Transferred Representation and Adaptive Fusion

Progressive Context-aware Graph Feature Learning for Target Re-identification

RRGCCAN: Re-Ranking Via Graph Convolution Channel Attention Network for Person Re-Identification

Learning Bi-directional Feature Propagation with Latent Layout Modeling for Group Re-identification.

Group Re-Identification: Leveraging and Integrating Multi-Grain Information.

The Research of Group Re-identification from Multiple Cameras

Uncertainty Modeling for Group Re-Identification

Learning Context Graph for Person Search

AAGCN: Adjacency-aware Graph Convolutional Network for Person Re-Identification

Patch-based Camera-Aware Person-to-group Learning and Group Similarity Strategy for Unsupervised Group Re-Identification

Person Re-Identification Using Group Constraint

PrGCN: Probability Prediction with Graph Convolutional Network for Person Re-Identification

Person Re-identification with Deep Similarity-Guided Graph Neural Network