Two-branch 3D Convolution Neural Network for Gait Recognition.

Hui Huang,Yuanyu Zhang,Yuhang Si,Jin Wang,Dongzhi He
DOI: https://doi.org/10.1007/s11760-023-02573-4
2023-01-01
Abstract:Gait recognition is one of the essential biometric technologies. It is widely used in security surveillance and other fields. The key to gait recognition is to extract robust spatio-temporal features from the gait silhouette sequences of pedestrians. Due to the overlapping and the cross-view, learning distinguishable spatio-temporal features and reducing the impact on recognition accuracy in occlusion situations such as backpacks and wearing coats is a crucial problem to be solved for gait recognition. In this paper, we propose a two-branch gait recognition network containing global and local branches, which extracts local and global spatio-temporal gait features using 3D convolutional neural networks and maps the obtained features to the corresponding dimensions. Specifically, in the global branch, we design an enhanced 3D convolution module (E3D) for global spatio-temporal feature extraction. In the local branch, we design the Partical-E3D module. The Partical-E3D module divides the features in the vertical direction by averaging the chunks and cascades them to obtain the local features after using the E3D module to extract the features for each local part of the division. In addition, for the features extracted in global and local branches, we not only perform feature mapping in the spatial dimension but also in the temporal dimension to obtain the gait features with temporal and spatial information. Experiments on the CASIA-B dataset showed that our method achieved first-class accuracy rates of 97.8%, 95.1% and 84.3% under normal walking, bag carrying and coat wearing conditions. These metrics demonstrate that our method has better performance than existing gait recognition methods and has state-of-the-art performance, and the improvement is more obvious in the condition of BG and CL.
What problem does this paper attempt to address?