Dual-modal Tactile E-skin: Enabling Bidirectional Human-Robot Interaction via Integrated Tactile Perception and Feedback

Shilong Mu,Runze Zhao,Zenan Lin,Yan Huang,Shoujie Li,Chenchang Li,Xiao-Ping Zhang,Wenbo Ding

2024-02-08

Abstract:To foster an immersive and natural human-robot interaction, the implementation of tactile perception and feedback becomes imperative, effectively bridging the conventional sensory gap. In this paper, we propose a dual-modal electronic skin (e-skin) that integrates magnetic tactile sensing and vibration feedback for enhanced human-robot interaction. The dual-modal tactile e-skin offers multi-functional tactile sensing and programmable haptic feedback, underpinned by a layered structure comprised of flexible magnetic films, soft silicone, a Hall sensor and actuator array, and a microcontroller unit. The e-skin captures the magnetic field changes caused by subtle deformations through Hall sensors, employing deep learning for accurate tactile perception. Simultaneously, the actuator array generates mechanical vibrations to facilitate haptic feedback, delivering diverse mechanical stimuli. Notably, the dual-modal e-skin is capable of transmitting tactile information bidirectionally, enabling object recognition and fine-weighing operations. This bidirectional tactile interaction framework will enhance the immersion and efficiency of interactions between humans and robots.

Robotics,Signal Processing

What problem does this paper attempt to address?

The problem this paper attempts to address is achieving more natural and immersive bidirectional tactile perception and feedback in human-robot interaction (HRI). Specifically, the authors propose a bimodal electronic skin (e-skin) designed to enhance the human-robot interaction experience by integrating magnetic tactile sensing and vibration feedback. This bimodal electronic skin can provide multifunctional tactile perception and programmable tactile feedback, overcoming the limitations of existing single-function electronic skin technologies, thereby promoting more natural and efficient interaction in complex tasks.

The main contributions of the paper include:
1. Proposing an electronic skin that integrates multimodal tactile perception and programmable tactile feedback, addressing the limitations of previous unimodal electronic skins.
2. Designing experiments to demonstrate the application potential of the electronic skin in various fields, such as grasp recognition and programmable fine manipulation.
3. Proposing a framework for bidirectional transmission of tactile information, showcasing the potential for human-robot collaboration in complex tasks.

Through this research, the authors hope to provide richer, more natural, and more efficient tactile experiences for future human-robot interaction systems, particularly in areas such as robot-assisted operations and remote control.