Abstract:With the rapid advances in wearable electronics and photonics, self-sustainable wearable systems are desired to increase service life and reduce maintenance frequency. Triboelectric technology stands out as a promising versatile technology due to its flexibility, self-sustainability, broad material availability, low cost, and good scalability. Various triboelectric-human-machine interfaces (THMIs) have been developed including interactive gloves, eye blinking/body motion-triggered interfaces, voice/breath monitors, and self-induced wireless interfaces. Nonetheless, THMIs conventionally use electrical readout and produce pulse-like signals due to the transient charge flows, leading to unstable and lossy transfer of interaction information. To address this issue, we propose a strategy by equipping THMIs with robust nanophotonic aluminum nitride (AlN) modulators for readout. The electrically capacitive nature of AlN modulators enables THMIs to work in the open-circuit condition with negligible charge flows. Meanwhile, the interaction information is transduced from THMIs' voltage to AlN modulators' optical output via the electro-optic Pockels effect. Thanks to the negligible charge flow and the high-speed optical information carrier, stable, information-lossless, and real-time THMIs are achieved. Leveraging the design flexibility of THMIs and nanophotonic readout circuits, various linear sensitivities independent of force speeds are achieved in different interaction force ranges. Toward practical applications, we develop a smart glove to realize continuous real-time robotics control and virtual/augmented reality interaction. Our work demonstrates a generic approach for developing self-sustainable HMIs with stable, information-lossless, and real-time features for wearable systems.

Human-Machine Interaction via Dual Modes of Voice and Gesture Enabled by Triboelectric Nanogenerator and Machine Learning

A Delta‐Parallel‐Inspired Human Machine Interface by Using Self‐Powered Triboelectric Nanogenerator Toward 3D and VR/AR Manipulations

Wearable Triboelectric-Human-Machine Interface (THMI) Using Robust Nanophotonic Readout

A Self‐Powered Triboelectric Hybrid Coder for Human–Machine Interaction

Triboelectric-Inertial Sensing Glove Enhanced by Charge-Retained Strategy for Human-Machine Interaction.

Graphene‐based Dual‐function Acoustic Transducers for Machine Learning‐assisted Human–robot Interfaces

A Self-Powered, Skin Adhesive, and Flexible Human-Machine Interface Based on Triboelectric Nanogenerator

Optical‐Nanofiber‐Enabled Gesture‐Recognition Wristband for Human–Machine Interaction with the Assistance of Machine Learning

Advancing triboelectric human machine interfaces with core-sheath nanocomposite fibres: Enhanced flexibility and motion identification via machine learning

A smart glove with integrated triboelectric nanogenerator for self-powered gesture recognition and language expression

A triboelectric nanogenerator coupled with internal and external friction for gesture recognition based on EHD printing technology

Decoding Silent Speech Commands from Articulatory Movements Through Soft Magnetic Skin and Machine Learning

Flexible staircase triboelectric nanogenerator for motion monitoring and gesture recognition

3D printed triboelectric nanogenerator as self-powered human-machine interactive sensor for breathing-based language expression

A Machine Learning-Combined Flexible Sensor for Tactile Detection and Voice Recognition

An On-skin Triboelectric Sensor System Enabled by Heterogeneous Parallel Channel Fusion Model for Human-machine Interactions

Poster Abstract: TENG-enabled Self-powered Human-machine Interfaces for the Metaverse

Machine Learning Glove Using Self‐Powered Conductive Superhydrophobic Triboelectric Textile for Gesture Recognition in VR/AR Applications

Triboelectric Nanogenerators Based on Super-Stretchable Conductive Hydrogels with the Assistance of Deep-Learning for Handwriting Recognition

Deep-learning-assisted low-cost flexible cotton yarn-based triboelectric nanogenerator for ultra-sensitive human-computer merging interfaces

Roadmap to Human–Machine Interaction through Triboelectric Nanogenerator and Machine Learning Convergence