Cross‐domain extendable gesture recognition system using WiFi signals

Yuxi Qin,Su Pan,Zibo Li
DOI: https://doi.org/10.1049/ell2.12931
2023-08-29
Electronics Letters
Abstract:This letter proposes and implements WiCross, a cross‐domain WiFi‐based gesture recognition system based on a dynamically weighted multi‐label generative adversarial network. WiCross removes domain information of users, orientations, and environments from the channel state information and generates domain‐independent features that can be used in common classifiers. We propose a dynamic link weights algorithm to solve the cross‐orientations problem, which achieves better performance than existing systems. This letter proposes a cross‐domain WiFi‐based gesture recognition system (WiCross) based on a dynamically weighted multi‐label generative adversarial network. Most existing WiFi‐based gesture recognition systems are user, orientation, and environment sensitive, which limits the application of WiFi sensing. Compared with the influence of users and environments on WiFi sensing systems, the influence of orientation on WiFi sensing systems is more difficult to remove. To alleviate the confusion caused by the orientation more effectively, we arrange the transmitting and receiving antennas according to the characteristics of the Fresnel region. It is proposed to dynamically weight different links according to users' orientations and use a multi‐label generative adversarial network to obtain domain‐independent features. More importantly, WiCross can use domain‐independent features to classify some unknown gestures without modifying any code or dataset. Lightweight computing resource consumption allows WiCross to respond in real time. The experimental results show that WiCross can achieve an in‐domain recognition accuracy of 93.54% and a cross‐domain recognition accuracy of 93.11%.
engineering, electrical & electronic
What problem does this paper attempt to address?