Abstract:This work proposes a novel multimodal tactile sensor utilizing triboelectric mechanism to simultaneously decouple three modalities: materials, curvatures, and pressure. Integrated with deep learning, an object recognition system can be achieved with high accuracy. It also can be further developed to detect object softness under different touch gestures, highlighting its potential for real‐world applications in robotics. Recent developments in robotics increasingly highlight the importance of sensing technology, especially tactile perception, in enabling robots to effectively engage with their environment and interpret physical interactions. Due to power efficiency and low cost, the triboelectric mechanism has been frequently studied for measuring pressure and identifying materials to enhance robot perception. Nevertheless, there has been limited exploration of using the triboelectric effect to detect curved surfaces, despite their prevalence in daily lives. Here, a triboelectric multimodal tactile sensor (TMTS) of multilayered structural design is proposed to recognize distinct materials, curvatures, and pressure simultaneously, thus decoupling different modalities to enable more accurate detection. By attaching sensors to robotic fingertips and leveraging deep learning analytics, the quantitative curvature measurement provides more precise insights into an object's detailed geometric characteristics rather than merely assessing its overall shape, hence achieving automatic recognition of 12 grasped objects with 99.2% accuracy. The sensor can be further used to accurately recognize the softness of objects under different touch gestures of a robotic hand, achieving a 94.1% accuracy, demonstrating its significant potential for wide‐ranging applications in a future robotic‐enabled intelligent society.

A Multisensory Tactile System for Robotic Hands to Recognize Objects

A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

A multisensory-feedback tactile glove with dense coverage of sensing arrays for object recognition

Multifunctional Tactile Sensors for Object Recognition

Development of Robotic Hand Tactile Sensing System for Distributed Contact Force Sensing in Robotic Dexterous Multimodal Grasping

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

A Smart Artificial Finger with Multisensations of Matter, Temperature, and Proximity

Multimodal tactile sensing fused with vision for dexterous robotic housekeeping

Magnetostrictive-based multimodal tactile sensors for object recognition

A soft robotic system imitating the multimodal sensory mechanism of human fingers for intelligent grasping and recognition

Augmented Tactile Perception of Robotic Fingers Enabled by AI‐Enhanced Triboelectric Multimodal Sensors

Large‐Area Hand‐Covering Elastomeric Electronic Skin Sensor with Distributed Multifunctional Sensing Capability

Multifunctional Self-Powered Sensors Integrated on a Robot Hand for Detecting Temperature-Pressure Stimuli and Recognizing Objects

A multifunctional flexible sensor based on PI-MXene/SrTiO3 hybrid aerogel for tactile perception

A tactile sensing system capable of recognizing objects based on bioinspired self-sensing soft pneumatic actuator

Nondestructive identification of softness via bioinspired multisensory electronic skins integrated on a robotic hand

A novel tactile palm for robotic object manipulation

Soft Robotic Perception System with Ultrasonic Auto-Positioning and Multimodal Sensory Intelligence

A multi-dimensional tactile perception system based on triboelectric sensors: Towards intelligent sorting without seeing

A Biomimetic Tactile Palm for Robotic Object Manipulation