Abstract:Wearable ultrasound (US) is a novel sensing approach that shows promise in multiple application domains, and specifically in hand gesture recognition (HGR). In fact, US enables to collect information from deep musculoskeletal structures at high spatiotemporal resolution and high signal-to-noise ratio, making it a perfect candidate to complement surface electromyography for improved accuracy performance and on-the-edge classification. However, existing wearable solutions for US-based gesture recognition are not sufficiently low power for continuous, long-term operation. On top of that, practical hardware limitations of wearable US devices (limited power budget, reduced wireless throughput, and restricted computational power) set the need for the compressed size of models for feature extraction and classification. To overcome these limitations, this article presents a novel end-to-end approach for feature extraction from raw musculoskeletal US data suited for edge computing, coupled with an armband for HGR based on a truly wearable (12 cm2, 9 g), ultralow-power (ULP) (16 mW) US probe. The proposed approach uses a 1-D convolutional autoencoder (CAE) to compress raw US data by 20× while preserving the main amplitude features of the envelope signal. The latent features of the autoencoder are used to train an XGBoost classifier for HGR on datasets collected with a custom US armband, considering armband removal/repositioning in between sessions. Our approach achieves a classification accuracy of 96%. Furthermore, the proposed unsupervised feature extraction approach offers generalization capabilities for intersubject use, as demonstrated by testing the pretrained encoder on a different subject and conducting posttraining analysis, revealing that the operations performed by the encoder are subject-independent. The autoencoder is also quantized to 8-bit integers and deployed on a ULP wearable US probe along with the XGBoost classifier, allowing for a gesture recognition rate ≥ 25 Hz and leading to 21% lower power consumption [at 30 frames/s (FPS)] compared to the conventional approach (raw data transmission and remote processing).

An Ultra-low-power High-precision Dynamic Gesture Recognition Coprocessor Based On RISC-V Architecture

A 28 Nm, 397 Μw Real-Time Dynamic Gesture Recognition Chip Based on RISC-V Processor

Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors

Hand Gesture Recognition on a Resource-Limited Interactive Wristband

Analog Sensing and Computing Systems with Low Power Consumption for Gesture Recognition

Ultralow Power Processor Employing Block Instruction for ECG Applications

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Efficient High Cross-User Recognition Rate Ultrasonic Hand Gesture Recognition System

Design of A Compact Low-Power Human-Computer Interaction Equipment for Hand Motion

Day-night architecture: Development of an ultra-low power RISC-V processor for wearable anomaly detection

Deploying human activity recognition in embedded RISC-V processors

RVDLAHA: An RISC-V DLA Hardware Architecture for On-Device Real-Time Seizure Detection and Personalization in Wearable Applications

FPGA-based Lightweight QDS-CNN System for sEMG Gesture and Force Level Recognition

Architecture Design and VLSI Implementation of 3D Hand Gesture Recognition System

A Real-Time and Hardware-Efficient Processor for Skeleton-Based Action Recognition with Lightweight Convolutional Neural Network

Motion-Sensor Fusion-Based Gesture Recognition and Its Vlsi Architecture Design for Mobile Devices

Low-Power and Low-Cost AI Processor with Distributed-Aggregated Classification Architecture for Wearable Epilepsy Seizure Detection

A Method to Recognize Dynamic Gestures on Edge Embedded Devices

Unsupervised Feature Extraction From Raw Data for Gesture Recognition With Wearable Ultralow-Power Ultrasound

Energy-Efficient Dynamic Configurable Datapath Architecture for IoT Devices

Energy-Efficient Implementation of YOLOv8, Instance Segmentation, and Pose Detection on RISC-V SoC