A person re‐identification method for sports event scenes incorporating textual information mining
Runmin Wang,Yanbin Zhu,Zukun Wan,Hua Chen,Zhenlin Zhu,Weixin Zhou,Chang Han,Yajun Ding
DOI: https://doi.org/10.1049/ipr2.13038
IF: 2.3
2024-03-13
IET Image Processing
Abstract:This paper designs a multi‐source information mutual gain mechanism to improve the accuracy of the person re‐identification task. The contribution is threefold: (1) A mutual gain mechanism between a person's visual features and high‐level semantic information is designed to enhance the performance of person re‐identification methods. (2) To the best of the authors' knowledge, there exists a notable scarcity of athlete re‐identification datasets. A dataset (i.e. HNNU‐ReID8000) is constructed and made publicly available to facilitate research in the athlete re‐identification community. (3) Extensive experiment evaluations on two publicly available person re‐identification datasets, that is, the RBNR dataset and the HNNU‐ReID8000 dataset, demonstrate the remarkable superiority of this method. Person re‐identification represents a pivotal sub‐problem in image retrieval, boasting broad application prospects in fields such as intelligent security and video surveillance. However, most existing person re‐identification methods predominantly focus solely on visual features pertaining to the person targets, thereby disregarding some supporting information closely related to the scene context. In the context of athlete re‐identification during sports event scenes, the athlete bib number is fully considered, an important clue that can provide different athletes' identities, and the traditional visual features of the person and high‐level semantic information of the bib number text are fused. A multi‐source information mutual gain mechanism is designed to improve the accuracy of the person re‐identification task. In the existing only publicly available marathon bib number dataset RBNR, the recognition accuracy of this method is significantly superior to that of the existing person re‐identification method. In addition, this paper constructs and publishes an athlete re‐identification dataset (HNNU‐ReID8000) for mainstream sports events, and the mean average precision (mAP) value of this method reaches 96.1% on this dataset, significantly ahead of existing state‐of‐the‐art person re‐identification methods. The code and the HNNU‐ReID8000 dataset will be released at https://github.com/yanbin‐zhu/zyb_person‐reid.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology