Hand gesture recognition based on micro‐Doppler radar using graph neural network
Zhangjin Xiong,Kaixue Ma,Ningning Yan
DOI: https://doi.org/10.1049/ell2.13100
2024-02-03
Electronics Letters
Abstract:In this work, two significant challenges, that is, unequal length within frames and the amount of redundant information contained in the micro‐Doppler features, are solved. First, a micro‐Doppler graph representation method, which can be adapted to arbitrary‐sized frames and present key micro‐Doppler features in a sparse manner, is developed. Then, a multi‐scale graph‐based hand gesture recognition framework is proposed. Hand gesture recognition based on micro‐Doppler (MD) radar has garnered considerable attention from researchers as a potential method for human–computer interaction (HCI). However, two significant challenges, that is, obvious differences in MD map size and lots of redundant information contained in the MD maps, are encountered. Here, a multi‐scale graph‐based hand gesture recognition framework is proposed. First, a MD graph representation method is developed, which is adapted to arbitrary‐sized frames and enables to map the key features in a sparse manner. Then, the multi‐scale information from MD graph is fully extracted for hand gesture recognition. Experimental results show that the proposed framework achieves a state‐of‐the‐art accuracy of 96.73% on the four‐class radar hand gesture dataset, while reducing up to 99% of the redundant information in the MD maps. This framework requires only a little amount of memory storage with good hand gesture recognition capability, demonstrating its high potential in the HCI field.
engineering, electrical & electronic