HDNet: Hierarchical Dynamic Network for Gait Recognition using Millimeter-Wave Radar

Yanyan Huang,Yong Wang,Kun Shi,Chaojie Gu,Yu Fu,Cheng Zhuo,Zhiguo Shi

DOI: https://doi.org/10.48550/arXiv.2211.00312

2022-11-01

Abstract:Gait recognition is widely used in diversified practical applications. Currently, the most prevalent approach is to recognize human gait from RGB images, owing to the progress of computer vision technologies. Nevertheless, the perception capability of RGB cameras deteriorates in rough circumstances, and visual surveillance may cause privacy invasion. Due to the robustness and non-invasive feature of millimeter wave (mmWave) radar, radar-based gait recognition has attracted increasing attention in recent years. In this research, we propose a Hierarchical Dynamic Network (HDNet) for gait recognition using mmWave radar. In order to explore more dynamic information, we propose point flow as a novel point clouds descriptor. We also devise a dynamic frame sampling module to promote the efficiency of computation without deteriorating performance noticeably. To prove the superiority of our methods, we perform extensive experiments on two public mmWave radar-based gait recognition datasets, and the results demonstrate that our model is superior to existing state-of-the-art methods.

Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to extract and utilize dynamic information more efficiently to improve recognition performance when using millimeter - wave radar for gait recognition. Specifically, the existing gait recognition methods based on millimeter - wave radar mainly focus on spatio - temporal feature aggregation within data frames and ignore the information between frames. This leads to insufficient mining of gait dynamic characteristics and limits the performance of the recognition system.

To solve this problem, the author proposes a Hierarchical Dynamic Network (HDNet) and captures the dynamic changes between frames by introducing a new point - cloud feature descriptor - Point Flow. In addition, in order to improve computational efficiency, the author also designs a Dynamic Frame Sampling (DFS) module to adaptively select frames with large amounts of information, thereby reducing computational complexity without significantly degrading performance.

Extensive experiments on two publicly available millimeter - wave radar gait recognition datasets have proven that the proposed method is superior to the existing state - of - the - art methods in recognition accuracy. Specifically, HDNet achieves a recognition accuracy of 96.52% on the mmGait dataset and 91.4% on the STPointGCN dataset, which are 11.61% and 15.89% higher than the existing best methods respectively. These results indicate that by effectively using the dynamic information between frames, the performance of gait recognition can be significantly improved.