Abstract:The human–machine interface (HMI) previously relied on a single perception interface that cannot realize three-dimensional (3D) interaction and convenient and accurate interaction in multiple scenes. Here, we propose a collaborative interface including electrooculography (EOG) and tactile perception for fast and accurate 3D human–machine interaction. The EOG signals are mainly used for fast, convenient, and contactless 2D (XY-axis) interaction, and the tactile sensing interface is mainly utilized for complex 2D movement control and Z-axis control in the 3D interaction. The honeycomb graphene electrodes for the EOG signal acquisition and tactile sensing array are prepared by a laser-induced process. Two pairs of ultrathin and breathable honeycomb graphene electrodes are attached around the eyes for monitoring nine different eye movements. A machine learning algorithm is designed to train and classify the nine different eye movements with an average prediction accuracy of 92.6%. Furthermore, an ultrathin (90 μm), stretchable (∼1000%), and flexible tactile sensing interface assembled by a pair of 4 × 4 planar electrode arrays is attached to the arm for 2D movement control and Z-axis interaction, which can realize single-point, multipoint and sliding touch functions. Consequently, the tactile sensing interface can achieve eight directions control and even more complex movement trajectory control. Meanwhile, the flexible and ultrathin tactile sensor exhibits an ultrahigh sensitivity of 1.428 kPa–1 in the pressure range 0–300 Pa with long-term response stability and repeatability. Therefore, the collaboration between EOG and the tactile perception interface will play an important role in rapid and accurate 3D human–machine interaction.The Supporting Information is available free of charge at https://pubs.acs.org/doi/10.1021/acsnano.2c01310.SEM images, EOG measurement method, EOG signals, relative capacitance variation of tactile sensors, detailed 800 cycles of the tactile sensor, stress–strain curves, detailed 1000 cycles of the strain sensor, and finger and wrist bending tests (PDF)This article has not yet been cited by other publications.

Human‐Machine Interfaces: A Delta‐Parallel‐Inspired Human Machine Interface by Using Self‐Powered Triboelectric Nanogenerator Toward 3D and VR/AR Manipulations (adv. Mater. Technol. 1/2021)

A Delta‐Parallel‐Inspired Human Machine Interface by Using Self‐Powered Triboelectric Nanogenerator Toward 3D and VR/AR Manipulations

Progress in the Triboelectric Human–Machine Interfaces (HMIs)-Moving from Smart Gloves to AI/Haptic Enabled HMI in the 5G/IoT Era

Poster Abstract: TENG-enabled Self-powered Human-machine Interfaces for the Metaverse

A Self-Powered, Skin Adhesive, and Flexible Human-Machine Interface Based on Triboelectric Nanogenerator

Noncontact Human-Machine Interface Using Complementary Information Fusion Based on MEMS and Triboelectric Sensors

Hybridized wearable patch as a multi-parameter and multi-functional human-machine interface

Wearable Triboelectric-Human-Machine Interface (THMI) Using Robust Nanophotonic Readout

A Stereoscopically Structured Triboelectric Nanogenerator for Bending Sensors and Hierarchical Interactive Systems

Recent Progress of Tactile and Force Sensors for Human-Machine Interaction

A Robust and Wearable Triboelectric Tactile Patch as Intelligent Human-Machine Interface

Minimalist and multi-functional human machine interface (HMI) using a flexible wearable triboelectric patch

All-in-One Self-Powered Human–Machine Interaction System for Wireless Remote Telemetry and Control of Intelligent Cars

A Self‐Powered Triboelectric Hybrid Coder for Human–Machine Interaction

Wearable triboelectric devices for haptic perception and VR/AR applications

Electrooculography and Tactile Perception Collaborative Interface for 3D Human–Machine Interaction

Advancing triboelectric human machine interfaces with core-sheath nanocomposite fibres: Enhanced flexibility and motion identification via machine learning

Triboelectric bending sensor based smart glove towards intuitive multi-dimensional human-machine interfaces

Ionic hydrogels-based triboelectric nanogenerators for self-powered human–machine interfaces

Human-machine Interface for a Master-Slave Hydraulic Manipulator with Vision Enhancement and Auditory Feedback

Recent advances in piezoelectric and triboelectric self-powered sensors for human-machine interface applications