Toward more naturalistic tactile sensors

Silvestro Micera

DOI: https://doi.org/10.1126/science.adp2623

IF: 56.9

2024-05-10

Science

Abstract:An artificial tactile system mimicking human touch enables effective object recognition

multidisciplinary sciences

What problem does this paper attempt to address?

Multifunctional Tactile Sensors for Object Recognition

Linglu Wang,Xiangyu Qi,Chuanbo Li,Yang Wang

DOI: https://doi.org/10.1002/adfm.202409358

IF: 19

2024-08-28

Advanced Functional Materials

Abstract:Creating artificial sensors with finger‐like tactile capabilities is challenging due to the contradiction between structural compliance and multifunctional sensing. This work develops a sensor that responds to strain, material, and temperature stimuli using piezoresistive, triboelectric, and thermoelectric effects. The findings contribute to the development of sensory systems for object recognition in soft robotics Humans can grab and identify objects by capturing the features of physical shape, temperature, and material. However, creating artificial sensors with finger‐like tactile capabilities is challenging due to the contradiction between structural compliance and multifunctional sensing. Here, a sensory system for a robot hand that can achieve object recognition is reported. The sensor with a simple horizontal sensing structure can respond to strain, material, and temperature stimuli using piezoresistive, triboelectric, and thermoelectric effects. A machine learning algorithm to train and classify tactile sensing signals, enabling a high accuracy of 98.5% in recognizing five objects is also developed. This work contributes to the development of sensory systems for object recognition in soft robotics.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor

Carmelo Sferrazza,Raffaello D'Andrea,Raffaello D’Andrea

DOI: https://doi.org/10.3390/s19040928

IF: 3.9

2019-02-22

Sensors

Abstract:Human skin is capable of sensing various types of forces with high resolution and accuracy. The development of an artificial sense of touch needs to address these properties, while retaining scalability to large surfaces with arbitrary shapes. The vision-based tactile sensor proposed in this article exploits the extremely high resolution of modern image sensors to reconstruct the normal force distribution applied to a soft material, whose deformation is observed on the camera images. By embedding a random pattern within the material, the full resolution of the camera can be exploited. The design and the motivation of the proposed approach are discussed with respect to a simplified elasticity model. An artificial deep neural network is trained on experimental data to perform the tactile sensing task with high accuracy for a specific indenter, and with a spatial resolution and a sensing range comparable to the human fingertip.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Fingerprint-inspired Biomimetic Tactile Sensors for the Surface Texture Recognition

Liguo Qin,Luxin Hao,Xiaodong Huang,Rui Zhang,Shan Lu,Zheng Wang,Jianbo Liu,Zeyu Ma,Xiaohua Xia,Guangneng Dong

DOI: https://doi.org/10.1016/j.sna.2024.115275

IF: 4.291

2024-01-01

Sensors and Actuators A Physical

Abstract:A bionic tactile device is designed for object surface texture recognition, taking inspiration from the microstructure of human fingerprints. The sense of touch in humans is achieved through the frictional vibration and generation of electrical potential signals by subcutaneous receptors. Constructing a tactile sensing device involves generating distinct signals upon interacting with different materials. The piezoelectric film PVDF is particularly suitable as a sensitive material for sensors due to its excellent flexibility, strong mechanical strength, excellent dynamic response and cost-effectiveness. This paper presents the design of a PVDF-based fingerprint-inspired tactile sensor capable of differentiating various textures. By combining the collected signals with machine learning algorithms, diverse textures can be effectively identified. To demonstrate the sensor’s superior performance, two experiments were conducted—one focused on recognizing different material textures, and the other on recognizing Braille characters. The accuracy achieved in these experiments was 97.4% and 96.5%, respectively, highlighting the technology’s significant potential in intelligent robotics and human-computer interaction.
A Multisensory Tactile System for Robotic Hands to Recognize Objects

Guozhen Li,Rong Zhu

DOI: https://doi.org/10.1002/admt.201900602

IF: 6.8

2019-01-01

Advanced Materials Technologies

Abstract:Multisensory tactile systems play an important role in enhancing robot intelligence. A competent robotic tactile system needs to be simple in structure and easily operated, especially with multiple sensations, and have good coordinate ability like human skin. A novel multisensory tactile system for humanoid robotic hands is proposed, allowing the hand to identify objects by grasping and manipulating them. Robotic multifunction sensors based on skin-inspired thermosensation and structured with micro platinum ribbons partially covered with piezo-thermic silver-nanoparticle-doped porous polydimethylsiloxane membrane simultaneously and independently detect contact pressure, local ambient temperature, and thermal conductivity and temperature of an object. Multiple tactile information which is obtained by the robotic sensors is fused comprehensively based on neural network classification to identify diverse objects in uncertain and dynamic gripping with an object recognition accuracy of 95%. This multisensory system enables robotic hand to better interact with its environment, enhances robotic intelligence, and makes various complex tasks feasible for robots, such as sorting material or rescuing from fire or other disasters.
Design of a Biomimetic Tactile Sensor for Material Classification

Kevin Dai,Xinyu Wang,Allison M. Rojas,Evan Harber,Yu Tian,Nicholas Paiva,Joseph Gnehm,Evan Schindewolf,Howie Choset,Victoria A. Webster-Wood,Lu Li

DOI: https://doi.org/10.48550/arXiv.2203.15941

2022-03-30

Abstract:Tactile sensing typically involves active exploration of unknown surfaces and objects, making it especially effective at processing the characteristics of materials and textures. A key property extracted by human tactile perception is surface roughness, which relies on measuring vibratory signals using the multi-layered fingertip structure. Existing robotic systems lack tactile sensors that are able to provide high dynamic sensing ranges, perceive material properties, and maintain a low hardware cost. In this work, we introduce the reference design and fabrication procedure of a miniature and low-cost tactile sensor consisting of a biomimetic cutaneous structure, including the artificial fingerprint, dermis, epidermis, and an embedded magnet-sensor structure which serves as a mechanoreceptor for converting mechanical information to digital signals. The presented sensor is capable of detecting high-resolution magnetic field data through the Hall effect and creating high-dimensional time-frequency domain features for material texture classification. Additionally, we investigate the effects of different superficial sensor fingerprint patterns for classifying materials through both simulation and physical experimentation. After extracting time series and frequency domain features, we assess a k-nearest neighbors classifier for distinguishing between different materials. The results from our experiments show that our biomimetic tactile sensors with fingerprint ridges can classify materials with more than 8% higher accuracy and lower variability than ridge-less sensors. These results, along with the low cost and customizability of our sensor, demonstrate high potential for lowering the barrier to entry for a wide array of robotic applications, including model-less tactile sensing for texture classification, material inspection, and object recognition.

Robotics
Human-Touch-Inspired Material Recognition for Robotic Tactile Sensing

Yu Xie,Chuhao Chen,Dezhi Wu,Wenming Xi,Houde Liu

DOI: https://doi.org/10.3390/app9122537

2019-06-21

Applied Sciences

Abstract:This paper proposes a novel material recognition method for robotic tactile sensing. The method is composed of two steps. Firstly, a human-touch-inspired short-duration (1 s) slide action is conducted by the robot to obtain the tactile data. Then, the tactile data is processed with a machine learning algorithm, where 11 bioinspired features were designed to imitate the mechanical stimuli towards the four main types of tactile receptors in the skin. In this paper, a material database consisting of 144,000 tactile images is used to train seven classifiers, and the most accurate classifier is selected to recognize 12 household objects according to their properties and materials. In the property recognition, the materials are classified into 4 categories according to their compliance and texture, and the best accuracy reaches 96% in 36 ms. In the material recognition, the specific materials are recognized, and the best accuracy reaches 90% in 37 ms. The results verify the effectiveness of the proposed method.
Recent progress on tactile object recognition

Huaping Liu,Yupei Wu,Fuchun Sun,Di Guo

DOI: https://doi.org/10.1177/1729881417717056

IF: 1.714

2017-07-01

International Journal of Advanced Robotic Systems

Abstract:Conventional visual perception technology is subject to many restrictions, such as illumination, background clutter, and occlusion. Many intrinsic properties of objects, like stiffness, hardness, and internal state, cannot be effectively perceived by visual sensors. For robots, tactile perception is a key approach to obtain environmental and object information. Different from vision sensors, tactile sensors can directly measure some physical properties of objects and environment. At the same time, humans also utilize touch sensory receptors as an important means to perceive and interact with the environment. In this article, we present a detailed discussion on tactile object recognition problem. We divide the current studies on the tactile object recognition into three subcategories and detailed analysis has been put forward on them. In addition, we also discuss some advanced topics such as visual–tactile fusion, exploratory procedure, and data sets.

robotics
A robotic sensory system with high spatiotemporal resolution for texture recognition

Ningning Bai,Yiheng Xue,Shuiqing Chen,Lin Shi,Junli Shi,Yuan Zhang,Xingyu Hou,Yu Cheng,Kaixi Huang,Weidong Wang,Jin Zhang,Yuan Liu,Chuan Fei Guo

DOI: https://doi.org/10.1038/s41467-023-42722-4

2023-11-14

Abstract:Humans can gently slide a finger on the surface of an object and identify it by capturing both static pressure and high-frequency vibrations. Although modern robots integrated with flexible sensors can precisely detect pressure, shear force, and strain, they still perform insufficiently or require multi-sensors to respond to both static and high-frequency physical stimuli during the interaction. Here, we report a real-time artificial sensory system for high-accuracy texture recognition based on a single iontronic slip-sensor, and propose a criterion-spatiotemporal resolution, to corelate the sensing performance with recognition capability. The sensor can respond to both static and dynamic stimuli (0-400 Hz) with a high spatial resolution of 15 μm in spacing and 6 μm in height, together with a high-frequency resolution of 0.02 Hz at 400 Hz, enabling high-precision discrimination of fine surface features. The sensory system integrated on a prosthetic fingertip can identify 20 different commercial textiles with a 100.0% accuracy at a fixed sliding rate and a 98.9% accuracy at random sliding rates. The sensory system is expected to help achieve subtle tactile sensation for robotics and prosthetics, and further be applied to haptic-based virtual reality and beyond.
Nondestructive identification of softness via bioinspired multisensory electronic skins integrated on a robotic hand

Ye Qiu,Shenshen Sun,Xueer Wang,Kuanqiang Shi,Zhiqiang Wang,Xiaolong Ma,Wenan Zhang,Guanjun Bao,Ye Tian,Zheng Zhang,Hao Ding,Hao Chai,Aiping Liu,Huaping Wu

DOI: https://doi.org/10.1038/s41528-022-00181-9

IF: 14.6

2022-06-20

npj Flexible Electronics

Abstract:Tactile sensing is essentially required for dexterous manipulation in robotic applications. Mimicking human perception of softness identification in a non-invasive fashion, thus achieving satisfactory interaction with fragile objects remains a grand challenge. Here, a scatheless measuring methodology based on the multisensory electronic skins to quantify the elastic coefficient of soft materials is reported. This recognition approach lies in the preliminary classification of softness by piezoelectric signals with a modified machine learning algorithm, contributing to an appropriate contact force assignment for subsequent quantitative measurements via strain sensing feedback. The integration of multifunctional sensing system allows the manipulator to hold capabilities of self-sensing and adaptive grasping motility in response to objects with the various softness (i.e., kPa-MPa). As a proof-of-concept demonstration, the biomimetic manipulator cooperates with the robotic arm to realize the intelligent sorting of oranges varying in freshness, paving the way for the development of microsurgery robots, human-machine interfacing, and advanced prosthetics.

materials science, multidisciplinary,engineering, electrical & electronic
Perception of Surface Defects by Active Exploration with a Biomimetic Tactile Sensor

Raphaël Candelier,Georges Debrégeas,Alexis Prevost

DOI: https://doi.org/10.48550/arXiv.1007.4928

2010-07-28

Abstract:We investigate the transduction of tactile information during active exploration of finely textured surfaces using a novel tactile sensor mimicking the human fingertip. The sensor has been designed by integrating a linear array of 10 micro-force sensors in an elastomer layer. We measure the sensors' response to the passage of elementary topographical features in the form of a small hole on a flat substrate. The response is found to strongly depend on the relative location of the sensor with respect to the substrate/skin contact zone. This result can be quantitatively interpreted within the scope of a linear model of mechanical transduction, taking into account both the intrinsic response of individual sensors and the context-dependent interfacial stress field within the contact zone. Consequences on robotics of touch are briefly discussed.

Soft Condensed Matter,Medical Physics
A Biomimetic Tactile Palm for Robotic Object Manipulation

Ziwei Lei,Xutian Deng,Yi Wang,Zhihao Li,Xiaohui Xiao,Dong Han,Fei Chen,Miao Li

DOI: https://doi.org/10.1109/lra.2022.3202653

IF: 5.2

2022-10-01

IEEE Robotics and Automation Letters

Abstract:Tactile sensing plays a vital role for human hand function in terms of object exploration, grasping and manipulation. Different types of tactile sensors have been designed during the past decades, which are mainly focused on either the fingertips for grasping or the upper-body for human-robot interaction. In this letter, a novel soft tactile sensor has been designed to mimic the functionality of human palm that can estimate the contact state of different objects. The tactile palm mainly consists of three parts including an electrode array, a soft cover skin and the liquid resistance between them. The design principle and the fabrication process are described in details, with a number of experiments showcasing the effectiveness of the proposed design.

robotics
Seeing Through your Skin: Recognizing Objects with a Novel Visuotactile Sensor

F. R. Hogan,M. Jenkin,S. Rezaei-Shoshtari,Y. Girdhar,D. Meger,G. Dudek

DOI: https://doi.org/10.1109/wacv48630.2021.00126

2021-01-01

Abstract:We introduce a new class of vision-based sensor and associated algorithmic processes that combine visual imaging with high-resolution tactile sending, all in a uniform hardware and computational architecture. We demonstrate the sensor’s efficacy for both multi-modal object recognition and metrology. Object recognition is typically formulated as an unimodal task, but by combining two sensor modalities we show that we can achieve several significant performance improvements. This sensor, named the See-Through-your-Skin sensor (STS), is designed to provide rich multi-modal sensing of contact surfaces. Inspired by recent developments in optical tactile sensing technology, we address a key missing feature of these sensors: the ability to capture a visual perspective of the region beyond the contact surface. Whereas optical tactile sensors are typically opaque, we present a sensor with a semitransparent skin that has the dual capabilities of acting as a tactile sensor and/or as a visual camera depending on its internal lighting conditions. This paper details the design of the sensor, showcases its dual sensing capabilities, and presents a deep learning architecture that fuses vision and touch. We validate the ability of the sensor to classify household objects, recognize fine textures, and infer their physical properties both through numerical simulations and experiments with a smart countertop prototype.
A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

Yue Jiang,Lin Fan,Xilong Sun,Zehe Luo,Herong Wang,Rucong Lai,Jie Wang,Qiyang Gan,Ning Li,Jindong Tian

DOI: https://doi.org/10.1002/advs.202402705

2024-09-09

Abstract:Humans recognize and manipulate objects relying on the multidimensional force features captured by the tactile sense of skin during the manipulation. Since the current sensors integrated in robots cannot support the robots to sense the multiple interaction states between manipulator and objects, achieving human-like perception and analytical capabilities remains a major challenge for service robots. Prompted by the tactile perception involved in robots performing complex tasks, a multimodal tactile sensory system is presented to provide in situ simultaneous sensing for robots when approaching, touching, and manipulating objects. The system comprises a capacitive sensor owning the high sensitivity of 1.11E-2 pF mm-1, a triboelectricity nanogenerator with the fast response speed of 30 ms, and a pressure sensor array capable of 3D force detection. By Combining transfer learning models, which fuses multimodal tactile information to achieve high-precision (up to 95%) recognition of the multi-featured targets such as random hardness and texture information under random sampling conditions, including random grasp force and velocity. This sensory system is expected to enhance the intelligent recognition and behavior-planning capabilities of autonomous robots when performing complex tasks in undefined surrounding environments.
Artificial Fingertip with Embedded Fiber-Shaped Sensing Arrays for High Resolution Tactile Sensing

Johannes Weichart,Pragash Sivananthaguru,Fergal B Coulter,Thomas Burger,Christofer Hierold

DOI: https://doi.org/10.1089/soro.2022.0238

Abstract:Replication of the human sense of touch would be highly advantageous for robots or prostheses as it would allow an agile and dexterous interaction with the environment. The article presents an approach for the integration of a micro-electromechanical system sensing skin with 144 tactile sensors on a soft, human-sized artificial fingertip. The sensing technology consists of thin, 1D sensing strips which are wrapped around the soft and curved fingertip. The sensing strips include 0.5 mm diameter capacitive sensors which measure touch, vibrations, and strain at a resolution of 1 sensor/mm2. The method allows to leverage the advantages of sensing skins over other tactile sensing technologies while showing a solution to integrate such skins on a soft three-dimensional body. The adaptable sensing characteristics are dominated by the thickness of a spray coated silicone layer, encapsulating the sensors in a sturdy material. We characterized the static and dynamic sensing capabilities of the encapsulated taxels up to skin thicknesses of 600 μm. Taxels with 600 μm skin layers have a sensitivity of 6 fF/mN, corresponding to an ∼5 times higher sensitivity than a human finger if combined with the developed electronics. They can detect vibrations in the full tested range of 0-600 Hz. The softness of a human finger was measured to build an artificial sensing finger of similar conformity. Miniaturized readout electronics allow the readout of the full finger with 220 Hz, which enables the observation of touch and slipping events on the artificial finger, as well as the estimation of the contact force. Slipping events can be observed as vibrations registered by single sensors, whereas the contact force can be extracted by averaging sensor array readouts. We verified the sturdiness of the sensing technology by testing single coated sensors on a chip, as well as the completely integrated sensing fingertip by applying 15 N for 10,000 times. Qualitative datasets show the response of the fingertip to the touch of various objects. The focus of this article is the development of the sensing hardware and the basic characterization of the sensing performance.
Open‐Environment Tactile Sensing System: Towards Simple and Efficient Material Identification

Xuelian Wei,Baocheng Wang,Zhiyi Wu,Zhong Lin Wang

DOI: https://doi.org/10.1002/adma.202203073

IF: 29.4

2022-05-18

Advanced Materials

Abstract:Robotic perception can have simple and effective sensing functions that are unreachable for humans using only the isolated tactile perception method, with the assistance of triboelectric nanogenerator (TENG). However, the reliability of triboelectric sensors remains a major challenge due to the inherent environmental limitations. Here, an intelligent tactile sensing system that combines TENG and deep learning technology is proposed. Using a triboelectric triple tactile sensor (TTS) array, typical characteristics of each testing material can be maintained stably even under different contact conditions (touch conditions and external environmental conditions) by extracting features from three independent electrical signals as well as the normalized output signals. Furthermore, a convolutional neural network (CNN) model is integrated, and a high accuracy of 96.62% is achieved in a material identification task. Our tactile sensing system has been exhibited to an open environment for material identification and the real‐time demonstration. Compared to the complex process that humans must integrate multiple sensing (touching and viewing) to accomplish tactile perception, the proposed sensing system shows a huge advantage in cognitive learning for the visually impaired, biomimetic prosthetics, and virtual spaces construction. This article is protected by copyright. All rights reserved

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
Intelligent Recognition Using Ultralight Multifunctional Nano-Layered Carbon Aerogel Sensors with Human-Like Tactile Perception

Huiqi Zhao,Yizheng Zhang,Lei Han,Weiqi Qian,Jiabin Wang,Heting Wu,Jingchen Li,Yuan Dai,Zhengyou Zhang,Chris R. Bowen,Ya Yang

DOI: https://doi.org/10.1007/s40820-023-01216-0

IF: 26.6

2023-11-10

Nano-Micro Letters

Abstract:Highlights The tactile performance of ultralight multifunctional sensors can reach the level of human tactile perception. An individual sensor can provide multiple tactile sensations: pressure, temperature, materials recognition, and 3D location. Therefore, it is no longer necessary to integrate multiple sensing modules with different functions, which greatly simplifies system complexity and reduces energy loss. The tactile system with multimodal learning algorithms has universality and can accommodate object recognition tasks in various application scenarios (e.g., Mars and Kitchen).

materials science, multidisciplinary,physics, applied,nanoscience & nanotechnology
Digitizing Touch with an Artificial Multimodal Fingertip

Mike Lambeta,Tingfan Wu,Ali Sengul,Victoria Rose Most,Nolan Black,Kevin Sawyer,Romeo Mercado,Haozhi Qi,Alexander Sohn,Byron Taylor,Norb Tydingco,Gregg Kammerer,Dave Stroud,Jake Khatha,Kurt Jenkins,Kyle Most,Neal Stein,Ricardo Chavira,Thomas Craven-Bartle,Eric Sanchez,Yitian Ding,Jitendra Malik,Roberto Calandra

2024-11-05

Abstract:Touch is a crucial sensing modality that provides rich information about object properties and interactions with the physical environment. Humans and robots both benefit from using touch to perceive and interact with the surrounding environment (Johansson and Flanagan, 2009; Li et al., 2020; Calandra et al., 2017). However, no existing systems provide rich, multi-modal digital touch-sensing capabilities through a hemispherical compliant embodiment. Here, we describe several conceptual and technological innovations to improve the digitization of touch. These advances are embodied in an artificial finger-shaped sensor with advanced sensing capabilities. Significantly, this fingertip contains high-resolution sensors (~8.3 million taxels) that respond to omnidirectional touch, capture multi-modal signals, and use on-device artificial intelligence to process the data in real time. Evaluations show that the artificial fingertip can resolve spatial features as small as 7 um, sense normal and shear forces with a resolution of 1.01 mN and 1.27 mN, respectively, perceive vibrations up to 10 kHz, sense heat, and even sense odor. Furthermore, it embeds an on-device AI neural network accelerator that acts as a peripheral nervous system on a robot and mimics the reflex arc found in humans. These results demonstrate the possibility of digitizing touch with superhuman performance. The implications are profound, and we anticipate potential applications in robotics (industrial, medical, agricultural, and consumer-level), virtual reality and telepresence, prosthetics, and e-commerce. Toward digitizing touch at scale, we open-source a modular platform to facilitate future research on the nature of touch.

Robotics,Artificial Intelligence,Machine Learning
High Resolution Tactile Sensors for Curved Robotic Fingertips

Alin Drimus,Vince Jankovics,Matija Gorsic,Stefan Mátéfi-Tempfli

DOI: https://doi.org/10.1007/978-3-319-09435-9_37

2014-01-01

Abstract:Tactile sensing is a key element for various animals that interact with the environment and surrounding objects. Touch provides information about contact forces, torques and pressure distribution and by the means of exploration it provides object properties such as geometry, stiffness and texture[5]. For humans, extracting high level information from touch provides a better understanding of the objects manipulated while for insects it is essential for locomotion[3]. While robot designers have been using vision systems to provide the robot with information about its surroundings, this is not always trivial to obtain, dealing with limited accuracy, occlusions and calibration problems. In terms of sensors for static stimuli, such as pressure, there are a range of technologies that can be used to manufacture transducers with various results[5]. A simple approach is to use fingertips with a 6-DOF force-torque sensor for estimating contact conditions[1], but this only allows a single point of contact and is costly. In terms of fingertip and foot tip prototypes, tactile sensors are used for multi modal sensing, similar to biology, for pressure and dynamic stimuli. In this respect Hosoda et al. [4] propose an anthropomorphic fingertip which has randomly distributed straingauges and PVDF (polyvinylidene fluoride) transducers. In [7] a biomimetic tactile array is proposed that shows a low hysteresis and good sensitivity for skin like deformations.
Augmented Tactile Perception of Robotic Fingers Enabled by AI‐Enhanced Triboelectric Multimodal Sensors

Xi Zhao,Zhongda Sun,Chengkuo Lee

DOI: https://doi.org/10.1002/adfm.202409558

IF: 19

2024-08-10

Advanced Functional Materials

Abstract:This work proposes a novel multimodal tactile sensor utilizing triboelectric mechanism to simultaneously decouple three modalities: materials, curvatures, and pressure. Integrated with deep learning, an object recognition system can be achieved with high accuracy. It also can be further developed to detect object softness under different touch gestures, highlighting its potential for real‐world applications in robotics. Recent developments in robotics increasingly highlight the importance of sensing technology, especially tactile perception, in enabling robots to effectively engage with their environment and interpret physical interactions. Due to power efficiency and low cost, the triboelectric mechanism has been frequently studied for measuring pressure and identifying materials to enhance robot perception. Nevertheless, there has been limited exploration of using the triboelectric effect to detect curved surfaces, despite their prevalence in daily lives. Here, a triboelectric multimodal tactile sensor (TMTS) of multilayered structural design is proposed to recognize distinct materials, curvatures, and pressure simultaneously, thus decoupling different modalities to enable more accurate detection. By attaching sensors to robotic fingertips and leveraging deep learning analytics, the quantitative curvature measurement provides more precise insights into an object's detailed geometric characteristics rather than merely assessing its overall shape, hence achieving automatic recognition of 12 grasped objects with 99.2% accuracy. The sensor can be further used to accurately recognize the softness of objects under different touch gestures of a robotic hand, achieving a 94.1% accuracy, demonstrating its significant potential for wide‐ranging applications in a future robotic‐enabled intelligent society.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
A Distributed Tactile Sensor for Intuitive Human-Robot Interfacing

Andrea Cirillo,Pasquale Cirillo,Giuseppe De Maria,Ciro Natale,Salvatore Pirozzi

DOI: https://doi.org/10.1155/2017/1357061

IF: 2.336

2017-01-01

Journal of Sensors

Abstract:Safety of human-robot physical interaction is enabled not only by suitable robot control strategies but also by suitable sensing technologies. For example, if distributed tactile sensors were available on the robot, they could be used not only to detect unintentional collisions, but also as human-machine interface by enabling a new mode of social interaction with the machine. Starting from their previous works, the authors developed a conformable distributed tactile sensor that can be easily conformed to the different parts of the robot body. Its ability to estimate contact force components and to provide a tactile map with an accurate spatial resolution enables the robot to handle both unintentional collisions in safe human-robot collaboration tasks and intentional touches where the sensor is used as human-machine interface. In this paper, the authors present the characterization of the proposed tactile sensor and they show how it can be also exploited to recognize haptic tactile gestures, by tailoring recognition algorithms, well known in the image processing field, to the case of tactile images. In particular, a set of haptic gestures has been defined to test three recognition algorithms on a group of 20 users. The paper demonstrates how the same sensor originally designed to manage unintentional collisions can be successfully used also as human-machine interface.

engineering, electrical & electronic,instruments & instrumentation

Toward more naturalistic tactile sensors

Multifunctional Tactile Sensors for Object Recognition

Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor

Fingerprint-inspired Biomimetic Tactile Sensors for the Surface Texture Recognition

A Multisensory Tactile System for Robotic Hands to Recognize Objects

Design of a Biomimetic Tactile Sensor for Material Classification

Human-Touch-Inspired Material Recognition for Robotic Tactile Sensing

Recent progress on tactile object recognition

A robotic sensory system with high spatiotemporal resolution for texture recognition

Nondestructive identification of softness via bioinspired multisensory electronic skins integrated on a robotic hand

Perception of Surface Defects by Active Exploration with a Biomimetic Tactile Sensor

A Biomimetic Tactile Palm for Robotic Object Manipulation

Seeing Through your Skin: Recognizing Objects with a Novel Visuotactile Sensor

A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

Artificial Fingertip with Embedded Fiber-Shaped Sensing Arrays for High Resolution Tactile Sensing

Open‐Environment Tactile Sensing System: Towards Simple and Efficient Material Identification

Intelligent Recognition Using Ultralight Multifunctional Nano-Layered Carbon Aerogel Sensors with Human-Like Tactile Perception

Digitizing Touch with an Artificial Multimodal Fingertip

High Resolution Tactile Sensors for Curved Robotic Fingertips

Augmented Tactile Perception of Robotic Fingers Enabled by AI‐Enhanced Triboelectric Multimodal Sensors

A Distributed Tactile Sensor for Intuitive Human-Robot Interfacing