Attention-Based Gait Recognition and Walking Direction Estimation in Wi-Fi Networks

Yang Xu,Wei Yang,Min Chen,Sheng Chen,Liusheng Huang
DOI: https://doi.org/10.1109/tmc.2020.3012784
IF: 6.075
2022-02-01
IEEE Transactions on Mobile Computing
Abstract:Most existing Wi-Fi-based gait recognition systems consider gait cycle detection as a critical process. However, the noise mixed in dynamic measurements obtained from commercial Wi-Fi devices makes it hard to detect gait cycles. Herein, we adopt the attention-based Recurrent Neural Network (RNN) encoder-decoder and propose a cycle-independent human gait recognition and walking direction estimation system, termed AGait, in Wi-Fi networks. For capturing more human walking dynamics, two receivers together with one transmitter are deployed in different spatial layouts. The Channel State Information (CSI) from different receivers are first assembled and refined to form an integrated walking profile. Then, the RNN encoder reads and encodes the walking profile into primary feature vectors. Given a specific gait or direction sensing task, a corresponding and particular attention vector is computed by the decoder and is finally used to predict the target. The attention scheme motivates AGait to learn to adaptively align with different critical clips of CSI data for different tasks. We implement AGait on commercial Wi-Fi devices in three different indoor environments, and the experimental results demonstrate that AGait can achieve average <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.549ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 1097.4 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-46" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-31" x="910" y="-213"></use></g></svg></span>F1 scores of 97.32 to 89.77 percent for gait recognition from a group of 4 to 10 subjects and 97.41 percent for direction estimation from 8 walking directions.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-46" d="M48 1Q31 1 31 11Q31 13 34 25Q38 41 42 43T65 46Q92 46 125 49Q139 52 144 61Q146 66 215 342T285 622Q285 629 281 629Q273 632 228 634H197Q191 640 191 642T193 659Q197 676 203 680H742Q749 676 749 669Q749 664 736 557T722 447Q720 440 702 440H690Q683 445 683 453Q683 454 686 477T689 530Q689 560 682 579T663 610T626 626T575 633T503 634H480Q398 633 393 631Q388 629 386 623Q385 622 352 492L320 363H375Q378 363 398 363T426 364T448 367T472 374T489 386Q502 398 511 419T524 457T529 475Q532 480 548 480H560Q567 475 567 470Q567 467 536 339T502 207Q500 200 482 200H470Q463 206 463 212Q463 215 468 234T473 274Q473 303 453 310T364 317H309L277 190Q245 66 245 60Q245 46 334 46H359Q365 40 365 39T363 19Q359 6 353 0H336Q295 2 185 2Q120 2 86 2T48 1Z"></path><path stroke-width="1" id="MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs></svg>
computer science, information systems,telecommunications
What problem does this paper attempt to address?