Abstract:A flexible electronic skin‐based closed‐loop human–machine interface with bidirectional sensing and haptic feedback functions is proposed. The strain sensing, pressure sensing, and vibration feedback functions are integrated into one device through structural design without mutual interference. Human movement monitoring and diverse haptic vibration combinations are achieved for various wearable scenarios, demonstrating the applicability of the developed system. Human–machine interaction (HMI) establishes an interconnected bridge between humans and robots and plays a significant role in industry and medical fields. However, the conventional interface is bulky and rigid with a single function. It lacks feedback information to be provided to the user, limiting its application scenarios and the ability to complete complex tasks in a dynamic environment. Herein, a flexible bidirectional (FBD) interface with integrated multimodal sensing and haptic feedback and the development of an FBD‐based closed‐loop HMI platform are presented. The proposed FBD interface offers programmable haptic feedback through a coin vibration motor array to endow the user with better performance in missions. The multimodal sensing array can perceive signals of joint movement and the pressure imposed on the skin. In addition, the FBD interface exhibits significant advantages of flexibility and a compact structure. The experimental tests verify that the multimodal sensing module can accurately perceive various static and dynamic movements of a human. Furthermore, the actuation module can provide diverse haptic vibrations to convey different information to the user. Moreover, successful applications in the scenarios of bilateral robotic teleoperation and assistance of disabled people indicate great potential of the FBD interface for broad applications.

Electronic skin as wireless human-machine interfaces for robotic VR

Skin-integrated wireless haptic interfaces for virtual and augmented reality

Multifunctional Tactile Feedbacks Towards Compliant Robot Manipulations via 3D-Shaped Electronic Skin

Wireless programmable patterns of electro-hydraulic haptic electronic skins able to create surface morphology

Skin-Integrated Haptic Interfaces Enabled by Scalable Mechanical Actuators for Virtual Reality

Electronic Skin as Human–Robot Interface for Human Grasp Recognition in Home-Care Robots: Introducing a Complete Set of Resources

Multifunctional Electronic Skins Enable Robots to Safely and Dexterously Interact with Human

Dual-modal Tactile E-skin: Enabling Bidirectional Human-Robot Interaction via Integrated Tactile Perception and Feedback

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Large‐Area Hand‐Covering Elastomeric Electronic Skin Sensor with Distributed Multifunctional Sensing Capability

A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

A Skin-Integrated Multimodal Haptic Interface for Immersive Tactile Feedback

Neuro-inspired electronic skin for robots

A warm hug from a robot: A dual-mode e-skin with programming compliance

A large-area less-wires stretchable robot electronic skin

Integrated Multifunctional Electronic Skins with Low-Coupling for Complicated and Accurate Human-Robot Collaboration

Touch IoT enabled by wireless self-sensing and haptic-reproducing electronic skin

Electronic Skins for Healthcare Monitoring and Smart Prostheses

A Multi‐Module Sensing and Bi‐Directional HMI Integrating Interaction, Recognition, and Feedback for Intelligent Robots

Programming electronic skin with diverse skin-like properties