Abstract:By introducing a vertical localized crack into loop‐connected hydrogel fiber encapsulated by porous elastomer films, stretchable strain sensors featuring ultrahigh sensitivity, wide detection range, breathability, satisfactory stability, and fast response/recovery speeds are created. A wireless sign language recognition system is further developed to realize the accurate recognition of different sign language information with the aid of machine learning. Wearable strain sensors, capable of continuously detecting human movements, hold great application prospects in sign language gesture recognition to alleviate the daily communication barriers of the deaf and mute community. However, the unsatisfactory strain sensing performance (such as low sensitivity, narrow detection range, etc.) and wearing discomfort severely hinder their practical application. Here, high‐performance breathable hydrogel strain sensors are proposed by introducing an adjustable localized crack in a closed‐loop connected hydrogel fiber encapsulated by porous elastomer films. Upon loading/unloading of external strain, the dynamic opening/closing of the pre‐cut crack causes a rapid switching in the hydrogel conductive path, resulting in sharp changes in resistance and a high sensitivity. Consequently, the hydrogel‐based crack‐effect strain sensor exhibits a superb sensitivity (GF up to 3930), a broad detection range (from 0.02% to 80%), fast response/recovery time (78/52 ms), repeatability, and structural stability. Based on the capability to accurately detect various strains across the full range of human movements, a wireless sign language recognition system is developed to achieve a high recognition accuracy of 98.1% by encoding and decoding various sign language gestures with the assistance of machine learning, providing a robust platform for efficient sign language intelligibility and barrier‐free communication.

Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays

Soft Sign Language Interpreter on Your Skin

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

SignSpeaker: A Real-time, High-Precision SmartWatch-based Sign Language Translator

Robust hydrogel sensors for unsupervised learning enabled sign‐to‐verbal translation

Liquid metal-embedded hydrogel sensors for unsupervised learning enabled sign-to-verbal translation

American Sign Language Translation Using Wearable Inertial and Electromyography Sensors for Tracking Hand Movements and Facial Expressions

Combinatorial Bionic Hierarchical Flexible Strain Sensor for Sign Language Recognition with Machine Learning

Full-Fiber Auxetic-Interlaced Yarn Sensor for Sign-Language Translation Glove Assisted by Artificial Neural Network

Ultra‐Robust and Sensitive Flexible Strain Sensor for Real‐Time and Wearable Sign Language Translation

Low hysteresis, water retention, anti-freeze multifunctional hydrogel strain sensor for human–machine interfacing and real-time sign language translation

Ultrasensitive Textile Strain Sensors Redefine Wearable Silent Speech Interfaces with High Machine Learning Efficiency

Multimodal Hand/finger Movement Sensing and Fuzzy Encoding for Data‐efficient Universal Sign Language Recognition

Sign Language Conversation Interpretation Using Wearable Sensors and Machine Learning

All-weather, natural silent speech recognition via machine-learning-assisted tattoo-like electronics

Ultrasensitive and Breathable Hydrogel Fiber‐Based Strain Sensors Enabled by Customized Crack Design for Wireless Sign Language Recognition

Improvement of Chinese sign language translation system based on collaboration of arm and finger sensing nodes

SignSpeak: Open-Source Time Series Classification for ASL Translation

Sign language translation system based on micro-inertial measurement units and ZigBee network

Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors

Ultrasensitive Paper-Based Polyaniline/graphene Composite Strain Sensor for Sign Language Expression