Ring-a-Pose: A Ring for Continuous Hand Pose Tracking

Tianhong Catherine Yu,Guilin Hu,Ruidong Zhang,Hyunchul Lim,Saif Mahmud,Chi-Jung Lee,Ke Li,Devansh Agarwal,Shuyang Nie,Jinseok Oh,François Guimbretière,Cheng Zhang

2024-04-20

Abstract:We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses. Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand pose reflects differently. Ring-a-Pose imposes minimal obtrusions on the hand, unlike multi-ring or glove systems. It is not affected by the choice of clothing that may cover wrist-worn systems. In a series of three user studies with a total of 30 participants, we evaluate Ring-a-Pose's performance on pose tracking and micro-finger gesture recognition. Without collecting any training data from a user, Ring-a-Pose tracks continuous hand poses with a joint error of 14.1mm. The joint error decreases to 10.3mm for fine-tuned user-dependent models. Ring-a-Pose recognizes 7-class micro-gestures with a 90.60% and 99.27% accuracy for user-independent and user-dependent models, respectively. Furthermore, the ring exhibits promising performance when worn on any finger. Ring-a-Pose enables the future of smart rings to track and recognize hand poses using relatively low-power acoustic sensing.

Human-Computer Interaction

What problem does this paper attempt to address?

The main objective of this paper is to propose a new solution for continuous gesture tracking through a single, untethered smart ring—Ring-a-Pose. Specifically, the paper attempts to address the following key issues:

1. **Continuous Gesture Tracking**: Existing smart rings, due to spatial constraints, typically can only integrate miniaturized low-power sensors (such as heart rate sensors and inertial measurement units (IMUs)), which cannot independently track hand poses continuously. This is crucial for understanding user actions and intentions (e.g., in virtual reality (VR)/augmented reality (AR) interactions or human activity recognition). To overcome this limitation, the paper explores a novel active acoustic sensing technology.

2. **Simplified Sensing System**: Compared to previous systems that required multiple rings and wristbands, Ring-a-Pose can achieve continuous tracking of full hand poses with just one ring. This not only simplifies the requirements for wearable devices but also enhances the convenience and acceptance for daily use.

3. **Improved Versatility and Accuracy**: The paper validates that Ring-a-Pose can effectively track hand poses when worn on different fingers and achieves high accuracy without the need for user-specific training data. Additionally, the paper presents performance evaluation results for both user-independent and user-dependent models.

4. **Micro Gesture Recognition**: Besides continuous gesture tracking, Ring-a-Pose can also recognize fine micro gestures, which are crucial for natural interaction control.

5. **Low Power Design**: The design of Ring-a-Pose considers low power requirements, making it more practical for real-world applications.

In summary, the core contribution of this paper is the introduction of the first single-ring system that utilizes active acoustic sensing technology to achieve continuous gesture tracking while maintaining low power consumption and good versatility. This innovation not only addresses the limitations of existing smart rings in gesture tracking but also provides new possibilities for the future development of smart rings.