Abstract:The human–machine interface (HMI) previously relied on a single perception interface that cannot realize three-dimensional (3D) interaction and convenient and accurate interaction in multiple scenes. Here, we propose a collaborative interface including electrooculography (EOG) and tactile perception for fast and accurate 3D human–machine interaction. The EOG signals are mainly used for fast, convenient, and contactless 2D (XY-axis) interaction, and the tactile sensing interface is mainly utilized for complex 2D movement control and Z-axis control in the 3D interaction. The honeycomb graphene electrodes for the EOG signal acquisition and tactile sensing array are prepared by a laser-induced process. Two pairs of ultrathin and breathable honeycomb graphene electrodes are attached around the eyes for monitoring nine different eye movements. A machine learning algorithm is designed to train and classify the nine different eye movements with an average prediction accuracy of 92.6%. Furthermore, an ultrathin (90 μm), stretchable (∼1000%), and flexible tactile sensing interface assembled by a pair of 4 × 4 planar electrode arrays is attached to the arm for 2D movement control and Z-axis interaction, which can realize single-point, multipoint and sliding touch functions. Consequently, the tactile sensing interface can achieve eight directions control and even more complex movement trajectory control. Meanwhile, the flexible and ultrathin tactile sensor exhibits an ultrahigh sensitivity of 1.428 kPa–1 in the pressure range 0–300 Pa with long-term response stability and repeatability. Therefore, the collaboration between EOG and the tactile perception interface will play an important role in rapid and accurate 3D human–machine interaction.The Supporting Information is available free of charge at https://pubs.acs.org/doi/10.1021/acsnano.2c01310.SEM images, EOG measurement method, EOG signals, relative capacitance variation of tactile sensors, detailed 800 cycles of the tactile sensor, stress–strain curves, detailed 1000 cycles of the strain sensor, and finger and wrist bending tests (PDF)This article has not yet been cited by other publications.

A Delta‐Parallel‐Inspired Human Machine Interface by Using Self‐Powered Triboelectric Nanogenerator Toward 3D and VR/AR Manipulations

A Self-Powered, Skin Adhesive, and Flexible Human-Machine Interface Based on Triboelectric Nanogenerator

Poster Abstract: TENG-enabled Self-powered Human-machine Interfaces for the Metaverse

A Stereoscopically Structured Triboelectric Nanogenerator for Bending Sensors and Hierarchical Interactive Systems

Progress in the Triboelectric Human–Machine Interfaces (HMIs)-Moving from Smart Gloves to AI/Haptic Enabled HMI in the 5G/IoT Era

A Self‐Powered Triboelectric Hybrid Coder for Human–Machine Interaction

Hybridized wearable patch as a multi-parameter and multi-functional human-machine interface

Wearable triboelectric devices for haptic perception and VR/AR applications

Noncontact Human-Machine Interface Using Complementary Information Fusion Based on MEMS and Triboelectric Sensors

A Robust and Wearable Triboelectric Tactile Patch as Intelligent Human-Machine Interface

All-in-One Self-Powered Human–Machine Interaction System for Wireless Remote Telemetry and Control of Intelligent Cars

Advancing triboelectric human machine interfaces with core-sheath nanocomposite fibres: Enhanced flexibility and motion identification via machine learning

Ionic hydrogels-based triboelectric nanogenerators for self-powered human–machine interfaces

Wearable Triboelectric-Human-Machine Interface (THMI) Using Robust Nanophotonic Readout

Smart touchless triboelectric nanogenerator towards safeguard and 3D morphological awareness

Minimalist and multi-functional human machine interface (HMI) using a flexible wearable triboelectric patch

Fiber-Based Triboelectric Nanogenerator for Mechanical Energy Harvesting and Its Application to a Human–Machine Interface

Triboelectric bending sensor based smart glove towards intuitive multi-dimensional human-machine interfaces

Human Body Electrode Enabled Direct Current Triboelectric Nanogenerator for Self‐Powered Wireless Human Motion and Environment Monitoring

Triboelectric and Iontronic Dual-Responsive Bioinspired Ionic Skin for Human–like Dexterous Robotic Manipulation

Electrooculography and Tactile Perception Collaborative Interface for 3D Human–Machine Interaction