Abstract:Radar-based gesture recognition combined machine learning methods can achieve excellent performance and has been utilized in a wide variety of applications. However, large-scale radar signal processing suffers from the risk of privacy leakage and the problem of limited computing resources. In this paper, we propose a federated learning framework based on the spiking neural network to solve above limitations in radar gesture recognition. First, we build a distributed federated learning system with good privacy protection to process radar data collaboratively, which only exchanges the model parameters between clients to train the model, without the need for transferring the data itself. Second, we train the spiking neural network using the spike timing dependent plasticity with biological interpretability, which is more compatible with the biological characteristics and can significantly reduce the energy consumption. Our creative combination of low-power spiking neural network and federated learning thus address the issue of resource constraint of edge nodes in federated learning. Furthermore, we introduce the weight pruning technique to the federated learning training process to reduce the model's communication cost. We conduct experiments on the 8GHz radar gesture dataset and Google Soli dataset to test the proposed model's validity. We evaluate the model's performance across various participating devices and examine the spiking neural network's capacity to recognize gestures under independent identical distribution and non-independent identical distribution strategies in federated learning. We also analyze the energy consumption and communication cost of the proposed model, demonstrating the spike timing dependent plasticity-based algorithm is more energy efficient than the traditional backpropagation as well as the backpropagation through time algorithms.

Sparsity Aware Dynamic Gesture Recognition Using Radar Sensors with Angular Diversity

Sparsity Aware Dynamic Gesture Classification Using Dual-Band Radar

Sparsity-Driven Micro-Doppler Feature Extraction for Dynamic Hand Gesture Recognition.

Sparsity-Based Dynamic Hand Gesture Recognition Using Micro-Doppler Signatures

A RD-T Network for Hand Gesture Recognition Based on Millimeter-Wave Sensor

Hand gesture recognition scheme based on millimeter-wave radar with convolutional neural network

Blind Separation of Doppler Human Gesture Signals Based on Continuous-Wave Radar Sensors

Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors

Dynamic Hand Gesture Recognition Based on Micro-Doppler Radar Signatures Using Hidden Gauss–Markov Models

Assisting the Visually Impaired: Multitarget Warning Through Millimeter Wave Radar and RGB-depth Sensors.

Effect of Sparsity‐aware Time–frequency Analysis on Dynamic Hand Gesture Classification with Radar Micro‐doppler Signatures

Dynamic Hand Gesture Classification Based On Radar Micro-Doppler Signatures

Simple and Efficient Gesture Recognition Based on Frequency-Modulated Continuous Wave Radar

A mmWave MIMO Radar-Based Gesture Recognition Using Fusion of Range, Velocity, and Angular Information

Hand gesture recognition based on micro‐Doppler radar using graph neural network

A Robust Hand Gesture Sensing and Recognition Based on Dual-Flow Fusion with FMCW Radar.

Clustering-Driven DGS-Based Micro-Doppler Feature Extraction for Automatic Dynamic Hand Gesture Recognition

A Low-Complexity Hand Gesture Recognition Framework via Dual mmWave FMCW Radar System

Radar Based Gesture Recognition in Embedded Systems

Federated Learning for Radar Gesture Recognition Based on Spike Timing Dependent Plasticity

Time-Space Dimension Reduction of Millimeter-Wave Radar Point-Clouds for Smart-Home Hand-Gesture Recognition