Abstract:Interactive hand mesh reconstruction from singleview images poses a significant challenge with the severe occlusion and depth ambiguity inherent in interactive hand gestures. Recent approaches that employ probabilistic models and tokenpruned techniques have shown decent results in multi-view human body reconstruction. Nevertheless, these methods have not fully utilized multi-scale semantic information from multiview images and are not applicable in scenarios involving severe occlusion during dual-hand interactions. Simultaneously, current single-view methods independently reconstruct the left and right hands, which are ineffective in enhancing the interaction between both hands. To address these challenges, we propose CAMInterHand, a cooperative attention-based method for multi-view interactive hand pose and mesh reconstruction. Specifically, CAMInterHand extracts local pyramid features and global vertex features from multi-scale feature maps of multi-view images, enabling the exploration of rich local semantic information and facilitating effective feature alignment. Furthermore, CAMInterHand employs the cooperative attention fusion module to fuse all features from multi-view images, enhancing interactions among vertices of dual hands within global and local contexts. We conduct extensive experiments on the large-scale multi-view dataset InterHand2.6M and CAMInterHand achieves a substantial performance improvement over existing methods for multi-view and single-view interactive hand reconstruction.

Natural Hand Posture Recognition Based on Zernike Moments and Hierarchical Classifier.

Hand Posture Recognition and Tracking Based on Bag-of-Words for Human Robot Interaction

Hierarchical Bag-Of-Features For Hand Posture Recognition

Dynamic hand gesture recognition using hidden Markov models

Saliency-guided Improvement for Hand Posture Detection and Recognition.

Hand Posture Recognition in Video Using Multiple Cues

Classroom Student Posture Recognition Based on an Improved High-Resolution Network.

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features

Hand posture recognition using finger geometric feature

View independent human posture identification using Kinect

Natural Gesture Modeling and Recognition Approach Based on Joint Movements and Arm Orientations

A Hierarchical Algorithm for Human Posture Recognition Based on Spatial and Frequency Domain Features

Automatic Recognition of Rat's Postures Based on Naive Bayes Classifier

CAMInterHand: Cooperative Attention for Multi-View Interactive Hand Pose and Mesh Reconstruction

Real-time Hand Posture Recognition Using Hand Geometric Features and Fisher Vector'

Human Posture Recognition for Human-Robot Interaction

A Real-Time Hand Posture Recognition System Using Deep Neural Networks

Real-time hand posture recognition based on hand dominant line using kinect

Single Image Depth Map Estimation for Improving Posture Recognition

Hand Gesture Recognition in Complex Background Based on Convolutional Pose Machine and Fuzzy Gaussian Mixture Models

A Fast Classification Approach to Upper-Limb Posture Recognition.