Denial of Service (DoS)

G. Portokalidis

DOI: https://doi.org/10.1007/978-1-4419-5906-5_1063

Abstract:

What problem does this paper attempt to address?

Fine Texture Detection Based on a Solid-Liquid Composite Flexible Tactile Sensor Array

Weiting Liu,Guoshi Zhang,Binpeng Zhan,Liang Hu,Tao Liu

DOI: https://doi.org/10.3390/mi13030440

IF: 3.4

2022-01-01

Micromachines

Abstract:Surface texture information plays an important role in the cognition and manipulation of an object. Vision and touch are the two main methods for extracting an object's surface texture information. However, vision is often limited since the viewing angle is uncertain during manipulation. In this article, we propose a fine surface texture detection method based on a stochastic resonance algorithm through a novel solid-liquid composite flexible tactile sensor array. A thin flexible layer and solid-liquid composite conduction structure on the sensor effectively reduce the attenuation of the contact force and enhance the sensitivity of the sensor. A series of ridge texture samples with different heights (0.9, 4, 10 mu m), different widths (0.3, 0.5, 0.7, 1 mm), but the same spatial period (2 mm) of ridges were used in the experiment. The experimental results prove that the stochastic resonance algorithm can significantly improve the signal characteristic of the output signal of the sensor. The sensor has the capability to detect fine ridge texture information. The mean relative error of the estimation for the spatial period was 1.085%, and the ridge width and ridge height, respectively, have a monotonic mapping relationship with the corresponding model output parameters. The sensing capability to sense a fine texture of tactile senor surpasses the limit of human fingers.
Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

Jie Jin,Shihang Wang,Zhongtan Zhang,Deqing Mei,Yancheng Wang,Chengkuo Lee,Ting He,Fengchong Lan

DOI: https://doi.org/10.20517/ss.2022.34

2023-01-01

Abstract:The robotic with integrated tactile sensors can accurately perceive contact force, pressure, vibration, temperature and other tactile stimuli.Flexible tactile sensing technologies have been widely utilized in intelligent robotics for stable grasping, dexterous manipulation, object recognition and human-machine interaction.This review presents promising flexible tactile sensing technologies and their potential applications in robotics.The significance of robotic sensing and tactile sensing performance requirements are first described.The commonly used six types of sensing mechanisms of tactile sensors are briefly illustrated, followed by the progress of novel structural design and performance characteristics of several promising tactile sensors, such as highly sensitive pressure and tri-axis force sensor, flexible distributed sensor array, and multi-modal tactile sensor.Then, the applications of using tactile sensors in robotics such as object properties recognition, grasping and manipulation, and human-machine interactions are thoroughly discussed.Finally, the challenges and future prospects of robotic tactile sensing technologies are discussed.In summary, this review will be conducive to the novel design of flexible tactile sensors and is a heuristic for developing the next generation of intelligent robotics with advanced tactile sensing functions in the future.
Finger‐Skin‐Inspired Flexible Optical Sensor for Force Sensing and Slip Detection in Robotic Grasping

Chengpeng Jiang,Zhang,Jing Pan,Yancheng Wang,Lei Zhang,Liming Tong

DOI: https://doi.org/10.1002/admt.202100285

2021-01-01

Advanced Materials & Technologies

Abstract:The finger skin of human plays a key role in amplifying and transferring tactile signals to sensory receptors, and it provides design guidelines for next‐generation flexible tactile sensors. To enable robotic applications such as dexterous manipulation and tactile feedback, the functions of force sensing and slip detection are crucial for flexible tactile sensors. Here, a finger‐skin inspired flexible optical (FIFO) sensor based on optical microfiber is reported, and this sensor has fingerprint‐like surface with parallel ridges and resin/polydimethylsiloxane multilayer structure with different stiffness, mimicking the structural characteristics of human finger skin. With these design features, the sensor is capable of measuring force with high durability and detecting slip with high sensitivity and short response time. Time‐resolved response curve and its wavelet transform provide useful information related to grasping and slipping when the sensor is in contact with objects with different shapes and materials. As a proof‐of‐concept demonstration, the sensor directly attached onto a robotic gripper is capable of measuring grasping force and monitoring object slippage during manipulation tasks, indicating its potential applications in advanced robotics.
Flexible Tactile Sensor Array for Slippage and Grooved Surface Recognition in Sliding Movement

Yancheng Wang,Jianing Chen,Deqing Mei

DOI: https://doi.org/10.3390/mi10090579

IF: 3.4

2019-01-01

Micromachines

Abstract:Flexible tactile sensor with contact force sensing and surface texture recognition abilities is crucial for robotic dexterous grasping and manipulation in daily usage. Different from force sensing, surface texture discrimination is more challenging in the development of tactile sensors because of limited discriminative information. This paper presents a novel method using the finite element modeling (FEM) and phase delay algorithm to investigate the flexible tactile sensor array for slippage and grooved surfaces discrimination when sliding over an object. For FEM modeling, a 3 × 3 tactile sensor array with a multi-layer structure is utilized. For sensor array sliding over a plate surface, the initial slippage occurrence can be identified by sudden changes in normal forces based on wavelet transform analysis. For the sensor array sliding over pre-defined grooved surfaces, an algorithm based on phase delay between different sensing units is established and then utilized to discriminate between periodic roughness and the inclined angle of the grooved surfaces. Results show that the proposed tactile sensor array and surface texture recognition method is anticipated to be useful in applications involving human-robotic interactions.
Fingerprint-inspired Dual-mode Pressure Sensor for Robotic Static and Dynamic Perception

Xiang Fu,Jianing Dong,Ling Li,Liang Zhang,Jiqiang Zhang,Longteng Yu,Qinhao Lin,Jiahe Zhang,Chengpeng Jiang,Jin Zhang,Yancheng Wang,Wenzhuo Wu,Fengru Fan,Yixiu Wang,Qing Yang

DOI: https://doi.org/10.1016/j.nanoen.2022.107788

2022-01-01

SSRN Electronic Journal

Abstract:The capability of perceiving the uncertain environment and the adaptation to external stimuli is of main concern in robotics. Inspired by the outer microstructure of the human fingerprint, a dual-mode tactile sensor is developed, consisting of capacitive sensing units for the static force perception, hybrid nanogenerators for the dynamic response and fingerprint-like hierarchical winkles. By leveraging the individual areas and jointing spaces, eight functional electrode points are defined, achieving position sensing with clear differentiation even under various operations, including tapping and sliding interactions. After conformally interrelating the piezoelectric layer into the triboelectric separator, the carbon-silicone composites enhanced capacitor with the as-designed functions can convert external mechanical energy into electricity, whilst detecting three-axis force with high sensitivity and wide linear range. Moreover, the device is demonstrated to detect high-frequency vibration and slow micro-friction phenomena, ensuring a stable and repeatable identification of the typical robotic hand movement.
A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Xiang Fu,Jiqiang Zhang,Jianliang Xiao,Yuran Kang,Longteng Yu,Chengpeng Jiang,Yuxiang Pan,Hao Dong,Shuaikang Gao,Yancheng Wang

DOI: https://doi.org/10.1039/d1nr03265h

IF: 6.7

2021-01-01

Nanoscale

Abstract:Tactile sensors are of great significance for robotic perception improvement to realize stable object manipulation and accurate object identification. To date, developing a broad-range tactile sensor array with high sensitivity economically remains a critical challenge. In this study, a flexible capacitive tactile sensor array, consisting of a carbon nanotube (CNT)/polydimethylsiloxane (PDMS) film, parylene films, and two polyimide (PI) films patterned with electrodes, is facilely prepared. The CNT/PDMS film, acting as a giant dielectric permittivity material, is utilized to improve the sensitivity, while the parylene film serves as the scaffold architecture to extend the working range of the tactile sensor array. Also, it is promising to realize mass production for this sensor array due to the scalable fabrication procedure. The as-prepared sensor exhibits excellent sensing performance with a high sensitivity of 1.61% kPa-1 (<1 MPa), an ultra-broad pressure working range of 0.9 kPa-2.55 MPa, an outstanding durability, a stability up to 5000 cycles, and a fast response time. By integrating our tactile sensor array with a robotic gripper, we show that robots can successfully differentiate object shapes and manipulate light and heavy objects with a closed-loop pressure feedback, demonstrating its great potential in robotic perception and wearable applications.
Flexible Tactile Sensor Array for Distributed Tactile Sensing and Slip Detection in Robotic Hand Grasping

Yancheng Wang,Xin Wu,Deqing Mei,Lingfeng Zhu,Jianing Chen

DOI: https://doi.org/10.1016/j.sna.2019.07.036

2019-01-01

Abstract:Distributed tactile information sensing is crucial for the stable grasping and manipulation of intelligent robotics. This paper presents a flexible tactile sensor array with spatial resolution of 3.5 mm that can be easily worn on the robotic hand for distributed three-axis contact force sensing in grasping applications. The proposed tactile sensor array has 3 x 3 sensing units, each unit has a five-electrode pattern's design and using conductive rubber as the sensing material. The fabricated prototype of the tactile sensor array has good flexibility, and its performance is characterized with high sensitivities: 0.471 V/N in x-axis and 0.466 V/N in y-axis. As for z-axis, the sensitivities are 0.201 V/N at 0 (6) over tildeN and 0.067 V/N at 6 (1) over tilde5 N measurement ranges. Then the tactile sensor array and its scanning circuit are integrated into the robotic hand for distributed three-axis contact force perception when grasping different objects. By using discrete wavelet transform analysis, the threshold values of wavelet coefficients for slip detection can be determined, and the slippage during robotic grasping of objects can be successfully detected. Therefore, the developed flexible tactile sensor array has the ability of detecting distributed contact forces and slippage simultaneously, and could be used for robotic dexterous grasping and manipulations. (C) 2019 Elsevier B.V. All rights reserved.
Recognition of surface texture with wearable tactile sensor array: A pilot Study

Yancheng Wang,Jianing Chen,Deqing Mei

DOI: https://doi.org/10.1016/j.sna.2020.111972

2020-01-01

Abstract:Discrimination of surface textures and their surface roughness using tactile sensors have attracted increasing attention. Highly sensitive tactile sensors with the ability to recognize and discriminate the surface textures and roughness of grasped objects are crucial for intelligent robotics. This paper presents a methodology by using the developed WMB model (W-M function and Beam-Bundle Theory) and an algorithm based on artificial neural network to study the performance of a flexible tactile sensor for surface texture classification. For the WMB model, the quasi-3D surfaces of specific objects are reconstructed based on W-M function and basic statistical theory. A simplified Beam-Bundle Model is utilized to represent the cover layer of the sensor and simulates the normal force fluctuations during sliding movements. According to the simulation results, surface textures can be classified by the characteristic frequency cluster (CFC) existing in the fluctuation of curve's spectrum. As an experiment, an artificial neural network is established to classify surface textures based on voltage signals from the tactile sensor. An MAF array represents the CFC information and improves the classification accuracy from 78 % to 82 %. The results demonstrate the effectiveness of the proposed WMB model and that it provides a new method of analysis involving robotic tactile interactions. (C) 2020 Elsevier B.V. All rights reserved.
Robust and Flexible Sliding Tactile Sensor for Surface Pattern Perception and Recognition

Zhihao Zhu,Yingtian Xu,Waner Lin,Zhixian Hu,Zhuofan Lin,Zhenglong Sun,Zhengchun Peng,Ziya Wang

DOI: https://doi.org/10.1002/aisy.202300225

IF: 7.298

2023-08-24

Advanced Intelligent Systems

Abstract:Herein, a flexible sliding tactile sensor that is inspired by the human fingertip, capable of constructing high‐resolution pattern images using just a few sensor cells, is proposed. Its unique deformation‐induced sensing mechanism provides a strongly correlated static response to unstructured pattern features and applied pressure. When combined with deep learning, this technology enables a robot to automatically classify significant patterns. Perceiving surface characteristics through tactile interaction typically requires high‐resolution devices or precise spatial scanning to record and analyze a significant amount of information. However, most available tactile sensors require complicated technological processes, redundant layouts, and data acquisition circuits, which limits their ability to provide a real‐time static perception and feedback for potential applications such as robotic manipulation. Drawing inspiration from the sliding tactile (ST) perception mode of the human fingertip, a robust and flexible ST sensor with a low array density of 2.7 cells cm−2 is reported. This innovative sensor has a soft and cambered configuration that allows it to rapidly and accurately recognize the 3D surface features of objects, including grooves as small as 500 μm. Benefiting from the strong correlation between collected electronic responding and local deformation of sensing cell, the ST sensor can adaptively reconstruct surface patterns with the assistance of deep learning, even on unstructured objects. The pattern recognition system based on the robot is demonstrated by accurately classifying a set of mahjong tiles with nearly 100% accuracy, surpassing human tactile perception capabilities in the same task.
Multifunctional Tactile Sensors for Object Recognition

Linglu Wang,Xiangyu Qi,Chuanbo Li,Yang Wang

DOI: https://doi.org/10.1002/adfm.202409358

IF: 19

2024-08-28

Advanced Functional Materials

Abstract:Creating artificial sensors with finger‐like tactile capabilities is challenging due to the contradiction between structural compliance and multifunctional sensing. This work develops a sensor that responds to strain, material, and temperature stimuli using piezoresistive, triboelectric, and thermoelectric effects. The findings contribute to the development of sensory systems for object recognition in soft robotics Humans can grab and identify objects by capturing the features of physical shape, temperature, and material. However, creating artificial sensors with finger‐like tactile capabilities is challenging due to the contradiction between structural compliance and multifunctional sensing. Here, a sensory system for a robot hand that can achieve object recognition is reported. The sensor with a simple horizontal sensing structure can respond to strain, material, and temperature stimuli using piezoresistive, triboelectric, and thermoelectric effects. A machine learning algorithm to train and classify tactile sensing signals, enabling a high accuracy of 98.5% in recognizing five objects is also developed. This work contributes to the development of sensory systems for object recognition in soft robotics.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
Design and Implementation of Robot Skin Using Highly Sensitive Sponge Sensor

Zhiqiu Ye,Geng Yang,Gaoyang Pang,Xiaoyan Huang,Huayong Yang

DOI: https://doi.org/10.1109/tmrb.2020.3020320

2020-01-01

IEEE Transactions on Medical Robotics and Bionics

Abstract:Robot skin, as a key component to collect tactile information, plays an important role in human-robot interaction (HRI). Conventional robot skin is mainly made of rigid components and bendable films, which cannot provide a fully soft physical interface in HRI. In addition, the sensitivity of robot skin is still to be enhanced so that robot could perceive touch behavior more precisely from a human. Here, a novel robot skin with features of high sensitivity and softness is designed in this article. The proposed robot skin is composed of a matrix of carbon black-polyurethane sponge sensor units through a foaming process. The sensitivity of the sensor is further enhanced by optimizing its geometric structure, based on the finite element method and physical experimental tests. The excellent cycling stability and transient responsiveness of the sponge sensor embedded into the robot skin endow host robots with an accurate long-term perception of both transient and quasi-static force. Finally, the validation of the robot skin is carried out by installing it on the back of a collaborative robot to perceive four touch modalities, illustrating great application prospects in affective HRI.
A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

Yue Jiang,Lin Fan,Xilong Sun,Zehe Luo,Herong Wang,Rucong Lai,Jie Wang,Qiyang Gan,Ning Li,Jindong Tian

DOI: https://doi.org/10.1002/advs.202402705

2024-09-09

Abstract:Humans recognize and manipulate objects relying on the multidimensional force features captured by the tactile sense of skin during the manipulation. Since the current sensors integrated in robots cannot support the robots to sense the multiple interaction states between manipulator and objects, achieving human-like perception and analytical capabilities remains a major challenge for service robots. Prompted by the tactile perception involved in robots performing complex tasks, a multimodal tactile sensory system is presented to provide in situ simultaneous sensing for robots when approaching, touching, and manipulating objects. The system comprises a capacitive sensor owning the high sensitivity of 1.11E-2 pF mm-1, a triboelectricity nanogenerator with the fast response speed of 30 ms, and a pressure sensor array capable of 3D force detection. By Combining transfer learning models, which fuses multimodal tactile information to achieve high-precision (up to 95%) recognition of the multi-featured targets such as random hardness and texture information under random sampling conditions, including random grasp force and velocity. This sensory system is expected to enhance the intelligent recognition and behavior-planning capabilities of autonomous robots when performing complex tasks in undefined surrounding environments.
Artificial Tactile Sensory Finger for Contact Pattern Identification Based on High Spatiotemporal Piezoresistive Sensor Array

Qiangqiang Ouyang,Xiaoying Wang,Shaoyi Wang,Zizhen Huang,Zhaohui Shi,Mao Pang,Bin Liu,Chee Keong Tan,Qintai Yang,Limin Rong

DOI: https://doi.org/10.1021/acsami.4c07056

IF: 9.5

2024-10-29

ACS Applied Materials & Interfaces

Abstract:Human fingertip tactile perception relies on the activation of densely distributed tactile receptors to identify contact patterns in the brain. Despite significant efforts to integrate tactile sensors with machine learning algorithms for recognizing physical patterns on object surfaces, developing a tactile sensing system that emulates human fingertip capabilities for identifying contact patterns with a high spatiotemporal resolution remains a formidable challenge. In this study, we present the...

materials science, multidisciplinary,nanoscience & nanotechnology
A flexible triboelectric tactile sensor for simultaneous material and texture recognition

Ziwu Song,Jihong Yin,Zihan Wang,Chengyue Lu,Ze Yang,Zihao Zhao,Zenan Lin,Jiyu Wang,Changsheng Wu,Jia Cheng,Yuan Dai,Yunlong Zi,Shao-Lun Huang,Xinlei Chen,Jian Song,Gang Li,Wenbo Ding

DOI: https://doi.org/10.1016/j.nanoen.2021.106798

IF: 17.6

2022-03-01

Nano Energy

Abstract:Electronic skin with tactile perception enables intelligent robots and prostheses to perform dexterous manipulation and natural interaction with the human and surroundings. However, using single tactile sensing mechanism to simultaneously percept geometry features and materials properties remains a challenge due to the bottleneck of signal decoupling. Herein, we report the MTSensing system – a wireless and fully-integrated tactile sensing system that can simultaneously recognize materials and textures based on a single flexible triboelectric sensor. The proposed triboelectric sensor converts touch into electrical signals and meanwhile, the signal processing pipeline decouples the signals into macro/micro features and feeds them into the corresponding deep learning models, which simultaneously predict the materials and textures of the contacted objects with the accuracies of 99.07% and 99.32%, respectively. The systematic integration of MTSensing hopes to pave the way for deploying low-cost and scalable electronic skin with multi-functional perceptions.

materials science, multidisciplinary,chemistry, physical,physics, applied,nanoscience & nanotechnology
Skin-inspired textile-based tactile sensors enable multifunctional sensing of wearables and soft robots

Yaokun Pang,Xianchen Xu,Shoue Chen,Yuhui Fang,Xiaodong Shi,Yiming Deng,Zhong-Lin Wang,Changyong Cao

DOI: https://doi.org/10.1016/j.nanoen.2022.107137

IF: 17.6

2022-06-01

Nano Energy

Abstract:Multifunctional tactile sensors that can mimic the sensory capabilities of human skin to perceive various external static and dynamic stimuli are essential to interact with the environment and humans for wearable electronics and soft intelligent robotics. Here, inspired by human skin, we report a textile-based tactile sensor capable of multifunctional sensing for personalized healthcare monitoring and soft robotic control. The tactile sensor consists of a triboelectric nanogenerator sensing layer to mimic the function of fast adapting (FA) mechanoreceptors and a piezoresistive sensing layer to achieve the functionality of slow adapting (SA) mechanoreceptors. The tactile sensor has been demonstrated to be able to recognize voice and monitor physiological signals and human motions in a real-time manner. Combined with a machine learning framework, the tactile sensor is able to percept surface textures and material types with high accuracy. It is also demonstrated as an effective human-machine interface for the control of assistive robotics.

materials science, multidisciplinary,chemistry, physical,physics, applied,nanoscience & nanotechnology
Design of a Biomimetic Tactile Sensor for Material Classification

Kevin Dai,Xinyu Wang,Allison M. Rojas,Evan Harber,Yu Tian,Nicholas Paiva,Joseph Gnehm,Evan Schindewolf,Howie Choset,Victoria A. Webster-Wood,Lu Li

DOI: https://doi.org/10.48550/arXiv.2203.15941

2022-03-30

Abstract:Tactile sensing typically involves active exploration of unknown surfaces and objects, making it especially effective at processing the characteristics of materials and textures. A key property extracted by human tactile perception is surface roughness, which relies on measuring vibratory signals using the multi-layered fingertip structure. Existing robotic systems lack tactile sensors that are able to provide high dynamic sensing ranges, perceive material properties, and maintain a low hardware cost. In this work, we introduce the reference design and fabrication procedure of a miniature and low-cost tactile sensor consisting of a biomimetic cutaneous structure, including the artificial fingerprint, dermis, epidermis, and an embedded magnet-sensor structure which serves as a mechanoreceptor for converting mechanical information to digital signals. The presented sensor is capable of detecting high-resolution magnetic field data through the Hall effect and creating high-dimensional time-frequency domain features for material texture classification. Additionally, we investigate the effects of different superficial sensor fingerprint patterns for classifying materials through both simulation and physical experimentation. After extracting time series and frequency domain features, we assess a k-nearest neighbors classifier for distinguishing between different materials. The results from our experiments show that our biomimetic tactile sensors with fingerprint ridges can classify materials with more than 8% higher accuracy and lower variability than ridge-less sensors. These results, along with the low cost and customizability of our sensor, demonstrate high potential for lowering the barrier to entry for a wide array of robotic applications, including model-less tactile sensing for texture classification, material inspection, and object recognition.

Robotics
Surface Texture Recognition by Deep Learning‐Enhanced Tactile Sensing

Youcan Yan,Zhe Hu,Yajing Shen,Jia Pan

DOI: https://doi.org/10.1002/aisy.202100076

IF: 7.298

2021-08-21

Advanced Intelligent Systems

Abstract:Tactile perception is a primary sensing channel for both humans and robots to be conscious of the surface properties of an object. Due to the unique functionalities of mechanoreceptors in human skin, humans can easily distinguish materials with different surface characteristics (e.g., compressibility, roughness, etc.) by simply pressing and sliding the fingertip over the samples. However, how to achieve such delicate texture recognition for robots remains an open challenge due to the lack of skin-comparable tactile sensing systems and smart pattern recognition algorithms. Herein, a novel texture recognition method is proposed by designing an arc-shaped soft tactile sensor and a bidirectional long short-term memory (LSTM) model with the attention mechanism. By using the proposed method, a respective recognition accuracy of 97% for Braille characters and 99% for 60 types of fabrics have been achieved, revealing the effectiveness of our method in surface texture recognition and the potential benefit to various applications, such as Braille reading for visually impaired people and defect detection in the textile industry.
Highly efficient recognition of similar objects based on ionic robotic tactile sensors

Yongkang Kong,Guanyin Cheng,Mengqin Zhang,Yongting Zhao,Wujun Meng,Xin Tian,Bihao Sun,Fuping Yang,Dapeng Wei

DOI: https://doi.org/10.1016/j.scib.2024.04.060

2024-07-15

Abstract:Tactile sensing provides robots the ability of object recognition, fine operation, natural interaction, etc. However, in the actual scenario, robotic tactile recognition of similar objects still faces difficulties such as low efficiency and accuracy, resulting from a lack of high-performance sensors and intelligent recognition algorithms. In this paper, a flexible sensor combining a pyramidal microstructure with a gradient conformal ionic gel coating was demonstrated, exhibiting excellent signal-to-noise ratio (48 dB), low detection limit (1 Pa), high sensitivity (92.96 kPa-1), fast response time (55 ms), and outstanding stability over 15,000 compression-release cycles. Furthermore, a Pressure-Slip Dual-Branch Convolutional Neural Network (PSNet) architecture was proposed to separately extract hardness and texture features and perform feature fusion. In tactile experiments on different kinds of leaves, a recognition rate of 97.16% was achieved, and surpassed that of human hands recognition (72.5%). These researches showed the great potential in a broad application in bionic robots, intelligent prostheses, and precise human-computer interaction.
A Multisensory Tactile System for Robotic Hands to Recognize Objects

Guozhen Li,Rong Zhu

DOI: https://doi.org/10.1002/admt.201900602

IF: 6.8

2019-01-01

Advanced Materials Technologies

Abstract:Multisensory tactile systems play an important role in enhancing robot intelligence. A competent robotic tactile system needs to be simple in structure and easily operated, especially with multiple sensations, and have good coordinate ability like human skin. A novel multisensory tactile system for humanoid robotic hands is proposed, allowing the hand to identify objects by grasping and manipulating them. Robotic multifunction sensors based on skin-inspired thermosensation and structured with micro platinum ribbons partially covered with piezo-thermic silver-nanoparticle-doped porous polydimethylsiloxane membrane simultaneously and independently detect contact pressure, local ambient temperature, and thermal conductivity and temperature of an object. Multiple tactile information which is obtained by the robotic sensors is fused comprehensively based on neural network classification to identify diverse objects in uncertain and dynamic gripping with an object recognition accuracy of 95%. This multisensory system enables robotic hand to better interact with its environment, enhances robotic intelligence, and makes various complex tasks feasible for robots, such as sorting material or rescuing from fire or other disasters.
A soft robotic system imitating the multimodal sensory mechanism of human fingers for intelligent grasping and recognition

Jinsui Xu,Boyi Xu,Hao Zhan,Zhijie Xie,Zhen Tian,Yifan Lu,Zheping Wang,Honghao Yue,Fei Yang

DOI: https://doi.org/10.1016/j.nanoen.2024.110120

IF: 17.6

2024-08-19

Nano Energy

Abstract:The sensory function is crucial for achieving precise feedback control and environmental interaction in soft robots. Therefore, the multimodal sensory capabilities that mimic human fingers have always been a research hotspot. This study proposes a design method for a soft robotic gripper that can emulate the multimodal perception mechanism of human fingers and achieve high-precision recognition of grasped objects using machine learning algorithms. In addition, a finger texture structure inspired by human fingerprints is designed using a negative pressure-induced buckling method to enhance the soft gripper's ability to perceive minute surface textures. Inspired by slow adapting (SA) receptors and fast adapting (FA) receptors of human fingers, we have innovatively designed a capacitive curvature sensor (CS) and a triboelectric texture sensor (TS) to detect the size, material, and texture of objects. Furthermore, a non-contact medium identification sensor (MIS), having a sensitivity of more than 1300 times higher compared to the traditional MISs, is fabricated using the principle of electromagnetic resonance. It is shown that by employing a deep learning-based multi-channel feature fusion network, the soft grasping system with multimodal sensing has achieved a recognition accuracy of 98.43% for different objects. This work provides an innovative approach for the application of soft robots in various fields, such as logistics sorting and food safety.

materials science, multidisciplinary,chemistry, physical,physics, applied,nanoscience & nanotechnology

Denial of Service (DoS)

Fine Texture Detection Based on a Solid-Liquid Composite Flexible Tactile Sensor Array

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

Finger‐Skin‐Inspired Flexible Optical Sensor for Force Sensing and Slip Detection in Robotic Grasping

Flexible Tactile Sensor Array for Slippage and Grooved Surface Recognition in Sliding Movement

Fingerprint-inspired Dual-mode Pressure Sensor for Robotic Static and Dynamic Perception

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Flexible Tactile Sensor Array for Distributed Tactile Sensing and Slip Detection in Robotic Hand Grasping

Recognition of surface texture with wearable tactile sensor array: A pilot Study

Robust and Flexible Sliding Tactile Sensor for Surface Pattern Perception and Recognition

Multifunctional Tactile Sensors for Object Recognition

Design and Implementation of Robot Skin Using Highly Sensitive Sponge Sensor

A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

Artificial Tactile Sensory Finger for Contact Pattern Identification Based on High Spatiotemporal Piezoresistive Sensor Array

A flexible triboelectric tactile sensor for simultaneous material and texture recognition

Skin-inspired textile-based tactile sensors enable multifunctional sensing of wearables and soft robots

Design of a Biomimetic Tactile Sensor for Material Classification

Surface Texture Recognition by Deep Learning‐Enhanced Tactile Sensing

Highly efficient recognition of similar objects based on ionic robotic tactile sensors

A Multisensory Tactile System for Robotic Hands to Recognize Objects

A soft robotic system imitating the multimodal sensory mechanism of human fingers for intelligent grasping and recognition