Real-Time and Accurate Gesture Recognition with Commercial RFID Devices

Shigeng Zhang,Zijing Ma,Chengwei Yang,Xiaoyan Kui,Xuan Liu,Weiping Wang,Jianxin Wang,Song Guo

DOI: https://doi.org/10.1109/tmc.2022.3211324

IF: 6.075

2022-01-01

IEEE Transactions on Mobile Computing

Abstract:Gesture recognition based on radio frequency identification (RFID) has attracted much research attention in recent years. Most existing RFID-based gesture recognition approaches use signal profile matching to distinguish different gestures, which incur large recognition latency and fail to support real-time applications. In this article, we design and implement ReActor, a real-time and accurate gesture recognition system that recognizes a user's gestures with low latency and high accuracy even when the gestures’speed varies. ReActor combines the time-domain statistical features and the frequency-domain features to precisely represent the signal profile corresponding to different gestures. To maintain high accuracy across different environments, we preprocess the signals to remove reflection signals from surrounding objects and use only the signals related to gestures to train the classifier. Moreover, we train a classifier to predict the speed of the gesture and feed the extracted features to different classifiers according to the speed. We implement ReActor and evaluate its performance in different scenarios. Experimental results show that ReActor achieves an average accuracy of 97.2% in recognizing 18 different gestures with an average latency of 72 ms, more than two orders of magnitude faster than approaches based on profile template matching.