Abstract:Existing methods combining skeleton and silhouette representations demonstrate explicit effectiveness for gait recognition. However, current related methods simply combine the video-level representations of model-based skeleton data and gait silhouettes for retrieval. Therefore, diverse skeleton information is not fully exploited in existing related works: Firstly, the position and movement of bones are not clear from individual silhouettes. This indicates that the frame-level interaction between features of skeletons and silhouettes is critical, which is ignored by previous methods. Secondly, diverse part-level skeleton-guided gait features are not fully captured in existing related approaches. To solve the above issues, we present a novel framework with multi-level skeleton-guided refinement, including frame-level, part-level, and video-level skeleton-guided refinement, for comprehensive skeleton-aided gait representation learning. First, two modules are proposed for frame-level skeleton-guided refinement. Specifically, Visual Skeleton Enhanced Backbone (VSEB) is proposed to visually highlight the global and part-level skeleton regions for the feature of each silhouette frame. Moreover, Cross-Visual-Model Frame-level Interaction (CVMFI) is proposed to further transfer the model-based skeleton information to features of the visual modalities. Secondly, part-level visual and model-based skeleton features are utilized to refine the final gait representation. Concretely, in VSEB, Part Skeleton Enhance Network (PSEN) is proposed to visually enhance the position and movement of part-level skeletons. In addition, Semantic Part Pooling (SPP) is proposed for capturing the model-based skeleton features of different semantic parts. Finally, as the video-level skeleton-guided refinement, multimodal video-level features are combined to boost the final recognition performance. Extensive experimental results on prevailing datasets demonstrate that our approach outperforms most existing methods, including the skeleton-aided multi-modal methods. With the multi-level refinement guided by the skeleton modalities, the framework is expected to provide a deeper understanding of skeleton-aided gait recognition.

ESP: Evaluation-Based Skeleton Pruning in Sensor Networks

CASE: Connectivity-Based Skeleton Extraction in Wireless Sensor Networks

A Skeleton Pruning Algorithm Based on Information Fusion

Mmskeleton: 3D Human Skeleton Estimation Using Millimeter Wave Radar Sparse Point Clouds

Real-time Skeletonization for Sketch-Based Modeling

A Pose Pruning Driven Solution to Pose Feature GraphSLAM

Skeleton construction in mobile social networks: Algorithms and applications

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

An Optimized L1-Medial Skeleton Extraction Algorithm

Global probability distribution structure-sparsity filter pruning for edge fault diagnosis in resource constrained wireless sensor networks

Energy-Efficient Coverage Based on Probabilistic Sensing Model in Wireless Sensor Networks.

Skeleton Prototype Contrastive Learning with Multi-Level Graph Relation Modeling for Unsupervised Person Re-Identification

Skeleton-Based Human Pose Recognition Using Channel State Information: A Survey

Skeleton-based Approaches based on Machine Vision: A Survey

Skeleton-Parted Graph Scattering Networks for 3D Human Motion Prediction

Constraint-Based Optimized Human Skeleton Extraction from Single-Depth Camera

Structural Knowledge Distillation for Efficient Skeleton-Based Action Recognition

A Comprehensive Study of Structural Pruning for Vision Models

On the Generation and Pruning of Skeletons Using Generalized Voronoi Diagrams

PowerSkel: A Device-Free Framework Using CSI Signal for Human Skeleton Estimation in Power Station

Gait Recognition With Multi-Level Skeleton-Guided Refinement