RF-Sign: Position-Independent Sign Language Recognition Using Passive RFID Tags
Haotian Zhang,Lukun Wang,Jiaming Pei,Feng Lyu,Minglu Li,Chao Liu
DOI: https://doi.org/10.1109/jiot.2023.3322228
IF: 10.6
2023-01-01
IEEE Internet of Things Journal
Abstract:Nowadays, sign language is becoming increasingly important in people’s daily life. Existing solutions are often based on wireless signals (e.g., acoustic, visible, and WiFi) or wearable sensors to recognize gestures, but they suffer from vulnerability to environmental influences, poor security, and high energy consumption, which prevent them from accurately capturing finger micro-movements. In this paper, we propose RF-Sign, which uses passive radio-frequency identification (RFID) tags to capture multiple finger micro-movements simultaneously to enable sign language support. In particular, two main issues are studied. One is the problem of positional differences when users make the same gesture, and the other is the problem of segmenting consecutive gestures using only empirical thresholding methods and ignoring the existence of differences in thresholds for different gestures. For position differences, we propose position models to normalize the hand’s horizontal rotation angle and radial distance. For segmenting consecutive gestures, we use the received signal strength (RSS) trend of the reference tag to represent the finger micro-movements state. The experimental results show that the average accuracy reaches 92.81% under different angles, distances and other conditions.
computer science, information systems,telecommunications,engineering, electrical & electronic