Scalable tactile sensor arrays on flexible substrates with high spatiotemporal resolution enabling slip and grip for closed-loop robotics

Hongseok Oh,Gyu-Chul Yi,Michael Yip,Shadi A. Dayeh

DOI: https://doi.org/10.1126/sciadv.abd7795

IF: 13.6

2020-11-13

Science Advances

Abstract:A single thin-film transistor senses, amplifies, and multiplexes force to sense slip and close the loop in robotic gripping.

multidisciplinary sciences

What problem does this paper attempt to address?

Flexible Tactile Sensor Array for Distributed Tactile Sensing and Slip Detection in Robotic Hand Grasping

Yancheng Wang,Xin Wu,Deqing Mei,Lingfeng Zhu,Jianing Chen

DOI: https://doi.org/10.1016/j.sna.2019.07.036

2019-01-01

Abstract:Distributed tactile information sensing is crucial for the stable grasping and manipulation of intelligent robotics. This paper presents a flexible tactile sensor array with spatial resolution of 3.5 mm that can be easily worn on the robotic hand for distributed three-axis contact force sensing in grasping applications. The proposed tactile sensor array has 3 x 3 sensing units, each unit has a five-electrode pattern's design and using conductive rubber as the sensing material. The fabricated prototype of the tactile sensor array has good flexibility, and its performance is characterized with high sensitivities: 0.471 V/N in x-axis and 0.466 V/N in y-axis. As for z-axis, the sensitivities are 0.201 V/N at 0 (6) over tildeN and 0.067 V/N at 6 (1) over tilde5 N measurement ranges. Then the tactile sensor array and its scanning circuit are integrated into the robotic hand for distributed three-axis contact force perception when grasping different objects. By using discrete wavelet transform analysis, the threshold values of wavelet coefficients for slip detection can be determined, and the slippage during robotic grasping of objects can be successfully detected. Therefore, the developed flexible tactile sensor array has the ability of detecting distributed contact forces and slippage simultaneously, and could be used for robotic dexterous grasping and manipulations. (C) 2019 Elsevier B.V. All rights reserved.
A Flexible Tactile Sensor Array Based on Pressure Conductive Rubber for Contact Force Measurement and Slip Detection

Yancheng Wang,Kailun Xi,Deqing Mei,Guanhao Liang,Zichen Chen

DOI: https://doi.org/10.20965/jrm.2016.p0378

2016-01-01

Journal of Robotics and Mechatronics

Abstract:[abstFig src='/00280003/14.jpg' width=""300"" text='A wearable tactile sensor array for three-axis contact force measurement and slip detection in prosthetic hand grasping' ] Using INASTAMOR pressure-conductive rubber as the sensing material, we developed a flexible tactile sensor array to measure three-axis contact force and slip. The sensor array has 9 (3 × 3) sensing units, each consisting of three layers, i.e., a bottom electrode, conductive rubber chips, a top polydimethylsiloxane (PDMS) bump. We detailed the array’s structural design, working principle, and fabrication process. We also characterize the array’s three-axis force measurement performance. The full-scale force measurement ranges and sensitivities in x-, y-, and z-axes are characterized as 5, 5, 20 N and 0.675, 0.677, 0.251 V/N, respectively. The array is mounted on a prosthetic hand for detecting contact force and slip occurrence in grasping. Results showed that the array measures three-axis contact force and detects slippage by using discrete wavelet transformation. The tactile sensor array has potential applications in robot-hand grasping that require simultaneous slip detection and three-axis contact force measurement.
Finger‐Skin‐Inspired Flexible Optical Sensor for Force Sensing and Slip Detection in Robotic Grasping

Chengpeng Jiang,Zhang,Jing Pan,Yancheng Wang,Lei Zhang,Liming Tong

DOI: https://doi.org/10.1002/admt.202100285

2021-01-01

Advanced Materials & Technologies

Abstract:The finger skin of human plays a key role in amplifying and transferring tactile signals to sensory receptors, and it provides design guidelines for next‐generation flexible tactile sensors. To enable robotic applications such as dexterous manipulation and tactile feedback, the functions of force sensing and slip detection are crucial for flexible tactile sensors. Here, a finger‐skin inspired flexible optical (FIFO) sensor based on optical microfiber is reported, and this sensor has fingerprint‐like surface with parallel ridges and resin/polydimethylsiloxane multilayer structure with different stiffness, mimicking the structural characteristics of human finger skin. With these design features, the sensor is capable of measuring force with high durability and detecting slip with high sensitivity and short response time. Time‐resolved response curve and its wavelet transform provide useful information related to grasping and slipping when the sensor is in contact with objects with different shapes and materials. As a proof‐of‐concept demonstration, the sensor directly attached onto a robotic gripper is capable of measuring grasping force and monitoring object slippage during manipulation tasks, indicating its potential applications in advanced robotics.
Flexible Tactile Sensor Array for Slippage and Grooved Surface Recognition in Sliding Movement

Yancheng Wang,Jianing Chen,Deqing Mei

DOI: https://doi.org/10.3390/mi10090579

IF: 3.4

2019-01-01

Micromachines

Abstract:Flexible tactile sensor with contact force sensing and surface texture recognition abilities is crucial for robotic dexterous grasping and manipulation in daily usage. Different from force sensing, surface texture discrimination is more challenging in the development of tactile sensors because of limited discriminative information. This paper presents a novel method using the finite element modeling (FEM) and phase delay algorithm to investigate the flexible tactile sensor array for slippage and grooved surfaces discrimination when sliding over an object. For FEM modeling, a 3 × 3 tactile sensor array with a multi-layer structure is utilized. For sensor array sliding over a plate surface, the initial slippage occurrence can be identified by sudden changes in normal forces based on wavelet transform analysis. For the sensor array sliding over pre-defined grooved surfaces, an algorithm based on phase delay between different sensing units is established and then utilized to discriminate between periodic roughness and the inclined angle of the grooved surfaces. Results show that the proposed tactile sensor array and surface texture recognition method is anticipated to be useful in applications involving human-robotic interactions.
A Flexible Capacitive Tactile Sensor Array for Prosthetic Hand Real-Time Contact Force Measurement.

Yancheng Wang,Kailun Xi,Guanghao Liang,Meging Mei,Zichen Chen

DOI: https://doi.org/10.1109/icinfa.2014.6932786

2014-01-01

Abstract:This paper develops a novel flexible capacitive tactile sensor array for prosthetic hand gripping force measurement. The sensor array has 8 × 8 (= 64) sensing units, each sensing unit has a four-layered structure: two thick PET layers with embedded copper electrodes generates a capacitor, a PDMS film with line-structure used as an insulation layer, and a top PDMS bump layer to concentrate external force. The structural design, working principle, and fabrication process of this sensor array are presented. The fabricated tactile sensor array features high flexibility has a spatial resolution of 2 mm. This is followed by the characterization of the sensing unit for normal force measurement and found that the sensing unit has two sensitivities: 4.82 0/00/mN for small contact force and 0.23 0/00/mN for large gripping force measurements. Finally, the tactile sensor array is integrated into a prosthetic hand for gripping force measurement. Results showed that the developed flexible capacitive tactile sensor array could be utilized for tactile sensing and real-time contact force visualization for prosthetic hand gripping applications.
Development of Fully Flexible Tactile Pressure Sensor with Bilayer Interlaced Bumps for Robotic Grasping Applications.

Lingfeng Zhu,Yancheng Wang,Deqing Mei,Chengpeng Jiang

DOI: https://doi.org/10.3390/mi11080770

IF: 3.4

2020-01-01

Micromachines

Abstract:Flexible tactile sensors have been utilized in intelligent robotics for human-machine interaction and healthcare monitoring. The relatively low flexibility, unbalanced sensitivity and sensing range of the tactile sensors are hindering the accurate tactile information perception during robotic hand grasping of different objects. This paper developed a fully flexible tactile pressure sensor, using the flexible graphene and silver composites as the sensing element and stretchable electrodes, respectively. As for the structural design of the tactile sensor, the proposed bilayer interlaced bumps can be used to convert external pressure into the stretching of graphene composites. The fabricated tactile sensor exhibits a high sensing performance, including relatively high sensitivity (up to 3.40% kPa-1), wide sensing range (200 kPa), good dynamic response, and considerable repeatability. Then, the tactile sensor has been integrated with the robotic hand finger, and the grasping results have indicated the capability of using the tactile sensor to detect the distributed pressure during grasping applications. The grasping motions, properties of the objects can be further analyzed through the acquired tactile information in time and spatial domains, demonstrating the potential applications of the tactile sensor in intelligent robotics and human-machine interfaces.
A Flexible Tactile Sensor Array Based On Pressure Conductive Rubber For Three-Axis Force And Slip Detection

Kailun Xi,Yancheng Wang,Deqing Mei,Guanhao Liang,Zichen Chen

DOI: https://doi.org/10.1109/AIM.2015.7222579

2015-01-01

Abstract:This paper presents a novel flexible tactile sensor array with the capabilities to measure three-dimensional (3D) forces and slip occurrence by using the INASTAMOR pressure conductive rubber as the sensing material. The tactile sensor array has 3 x 3(= 9) sensing units, and each unit has a three-layered structure: bottom electrode, middle conductive rubber chips, and top PDMS bump. The structural design, 3D force and slip detection principles, fabrication process of this sensor array are presented. The fabricated sensor array has a spatial resolution of 7 mm. 3D force measurement and slip detection performances of this sensor array are characterized experimentally. Results demonstrated that the sensor array can measure 3D forces. The full-scale range and sensitivities of force measurements for x-, y- and z-axes are 5 N, 5 N, 20 N and 0.65 V/N, 0.67 V/N, 0.23 V/N, respectively. Results also showed the sensor array could detect slipping by using the discrete wavelet transform (DWT) to analyze the measured force data. Thus, the proposed flexible tactile sensor array could be applied to robot hand grapsing application that requires slip detection and 3D contact force measurement.
A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Xiang Fu,Jiqiang Zhang,Jianliang Xiao,Yuran Kang,Longteng Yu,Chengpeng Jiang,Yuxiang Pan,Hao Dong,Shuaikang Gao,Yancheng Wang

DOI: https://doi.org/10.1039/d1nr03265h

IF: 6.7

2021-01-01

Nanoscale

Abstract:Tactile sensors are of great significance for robotic perception improvement to realize stable object manipulation and accurate object identification. To date, developing a broad-range tactile sensor array with high sensitivity economically remains a critical challenge. In this study, a flexible capacitive tactile sensor array, consisting of a carbon nanotube (CNT)/polydimethylsiloxane (PDMS) film, parylene films, and two polyimide (PI) films patterned with electrodes, is facilely prepared. The CNT/PDMS film, acting as a giant dielectric permittivity material, is utilized to improve the sensitivity, while the parylene film serves as the scaffold architecture to extend the working range of the tactile sensor array. Also, it is promising to realize mass production for this sensor array due to the scalable fabrication procedure. The as-prepared sensor exhibits excellent sensing performance with a high sensitivity of 1.61% kPa-1 (<1 MPa), an ultra-broad pressure working range of 0.9 kPa-2.55 MPa, an outstanding durability, a stability up to 5000 cycles, and a fast response time. By integrating our tactile sensor array with a robotic gripper, we show that robots can successfully differentiate object shapes and manipulate light and heavy objects with a closed-loop pressure feedback, demonstrating its great potential in robotic perception and wearable applications.
Development of Flexible Tactile Sensor for the Envelop of Curved Robotic Hand Finger in Grasping Force Sensing

Yancheng Wang,Wen Ding,Deqing Mei

DOI: https://doi.org/10.1016/j.measurement.2021.109524

IF: 5.6

2021-01-01

Measurement

Abstract:Intelligent robotic hand with integrated tactile sensor is able to perform real-time tactile information sensing, which is crucial for dexterous grasping and manipulation. This paper presents a novel flexible tactile sensor with 18 sensing units to envelop a complex-shaped robotic hand finger for grasping force measurement. A new approach based on point cloud fitting and triangular searching is developed to determine the special configuration of these 18 sensing units on the complex finger surface, and it is used for the structural design of the flexible tactile sensor. The fabrication process to make the tactile sensor is developed and fabricated tactile sensor features high flexibility and can be perfectly enveloped around robotic hand finger. Calibration results show that the sensor has relatively high sensitivities for three-axis force sensing: 1.87 V/N at 0.1 - 0.7 N and 0.47 V/N at 0.7 - 3 N for z-axis normal force sensing, 1.59 V/N and 1.49 V/N at -1 - 1 N for x- and y-axes shear force sensing, respectively. Besides, the tactile sensor has good reproducibility and generally low cross-talk interferences between the sensing units. After being wrapped onto robotic hand finger, this sensor is utilized to measure the distributed contact forces when the robotic hand grasps different objects. The effects of grasping movements on the generated contact forces are analyzed. The obtained results demonstrate that the developed tactile sensor has great potentials for the perception of tactile information in human-robotic interactions.
Optical and electrical dual-mode tactile sensor with interlinked interfaces recording normal force and slip for closed-loop robotics

Kedong Shang,Changliu He,Jian Zhou,Peng Ling,Xulei Lu,Chunqiao Fu,Yong Zhang,Chuan Tang,Linmao Qian,Tingting Yang

DOI: https://doi.org/10.1016/j.cej.2023.146279

IF: 15.1

2023-09-29

Chemical Engineering Journal

Abstract:The rapid development of electronic skin will allow disabled people and intelligent robots to interact more effectively with their surroundings. Nevertheless, it remains challenging to simultaneously capture multi-dimensional personalized information (including pressure and slip sensation) through simple device structure design with high stability under complex mechanical conditions. Here, a tactile sensor with simple structure and reliable performance (withstand considerable stretching, twisting, bending, and vibration) is designed for pressure and slip sensing. It is implemented by optical and electrical dual-mode sensing mechanisms and high toughness interlinked interface strategy (interfacial toughness ∼ 33.69 Jm −2 , nearly 5 times higher than control sample). This device is composed of a periodic microstructured piezoresistive layer and a triboelectrification-induced electroluminescent (TIEL) layer, both of which are based on the quasi-homogeneous PDMS (polydimethylsiloxane) composite. The whole device possesses the characteristics of lightness, flexibility, and light-transmitting. Besides, the device could automatically locate and track the slip motion while detecting the normal pressure in a large range (0–––1,000 kPa). As an application demonstration, the sensor is installed on a flexible manipulator and combined with the closed-loop control system. Compared to a single electrical mode, the optical and electrical dual-mode tactile sensor could more accurately monitor the sliding of the clamped object, adjust the clamping force instantly, and avoid object slipping. The unique performance of the device shows great potential in trajectory recognition, artificial limbs, intelligent robots, and human–machine interfaces.

engineering, chemical, environmental
Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

Jie Jin,Shihang Wang,Zhongtan Zhang,Deqing Mei,Yancheng Wang,Chengkuo Lee,Ting He,Fengchong Lan

DOI: https://doi.org/10.20517/ss.2022.34

2023-01-01

Abstract:The robotic with integrated tactile sensors can accurately perceive contact force, pressure, vibration, temperature and other tactile stimuli.Flexible tactile sensing technologies have been widely utilized in intelligent robotics for stable grasping, dexterous manipulation, object recognition and human-machine interaction.This review presents promising flexible tactile sensing technologies and their potential applications in robotics.The significance of robotic sensing and tactile sensing performance requirements are first described.The commonly used six types of sensing mechanisms of tactile sensors are briefly illustrated, followed by the progress of novel structural design and performance characteristics of several promising tactile sensors, such as highly sensitive pressure and tri-axis force sensor, flexible distributed sensor array, and multi-modal tactile sensor.Then, the applications of using tactile sensors in robotics such as object properties recognition, grasping and manipulation, and human-machine interactions are thoroughly discussed.Finally, the challenges and future prospects of robotic tactile sensing technologies are discussed.In summary, this review will be conducive to the novel design of flexible tactile sensors and is a heuristic for developing the next generation of intelligent robotics with advanced tactile sensing functions in the future.
A Novel Tactile Sensing Array with Elastic Steel Frame Structure for Prosthetic Hand.

Chunxin Gu,Weiting Liu,Xiao-dong Ruan,Xin Fu

DOI: https://doi.org/10.1007/978-3-319-43518-3_45

2016-01-01

Abstract:A novel tactile sensing array based on elastic steel frame structure for prosthetic hand is proposed. The sensing units are mounted on the curving surface of a 3D printed sensor holder with five along the axial direction and four in the circumferential direction. Each sensing unit consists of a steel frame, a silicon gauge and flexible printed circuit board FPCB. Based on the piezoresistive effect, the sensing unit can measure the normal force and the shear force along the longitudinal direction. The finite element analysis is conducted to evaluate the mechanical performance of the sensing unit. Meanwhile, the solution of detecting the resultant force is proposed.
Large-Area and Low-Cost Force/Tactile Capacitive Sensor for Soft Robotic Applications

Amir Pagoli,Frédéric Chapelle,Juan-Antonio Corrales-Ramon,Youcef Mezouar,Yuri Lapusta

DOI: https://doi.org/10.3390/s22114083

IF: 3.9

2022-05-28

Sensors

Abstract:This paper presents a novel design and development of a low-cost and multi-touch sensor based on capacitive variations. This new sensor is very flexible and easy to fabricate, making it an appropriate choice for soft robot applications. Materials (conductive ink, silicone, and control boards) used in this sensor are inexpensive and easily found in the market. The proposed sensor is made of a wafer of different layers, silicone layers with electrically conductive ink, and a pressure-sensitive conductive paper sheet. Previous approaches like e-skin can measure the contact point or pressure of conductive objects like the human body or finger, while the proposed design enables the sensor to detect the object's contact point and the applied force without considering the material conductivity of the object. The sensor can detect five multi-touch points at the same time. A neural network architecture is used to calibrate the applied force with acceptable accuracy in the presence of noise, variation in gains, and non-linearity. The force measured in real time by a commercial precise force sensor (ATI) is mapped with the produced voltage obtained by changing the layers' capacitance between two electrode layers. Finally, the soft robot gripper embedding the suggested tactile sensor is utilized to grasp an object with position and force feedback signals.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Finger

Elliott Donlon,Siyuan Dong,Melody Liu,Jianhua Li,Edward Adelson,Alberto Rodriguez

DOI: https://doi.org/10.48550/arXiv.1803.00628

2018-05-16

Abstract:This work describes the development of a high-resolution tactile-sensing finger for robot grasping. This finger, inspired by previous GelSight sensing techniques, features an integration that is slimmer, more robust, and with more homogeneous output than previous vision-based tactile sensors. To achieve a compact integration, we redesign the optical path from illumination source to camera by combining light guides and an arrangement of mirror reflections. We parameterize the optical path with geometric design variables and describe the tradeoffs between the finger thickness, the depth of field of the camera, and the size of the tactile sensing area. The sensor sustains the wear from continuous use -- and abuse -- in grasping tasks by combining tougher materials for the compliant soft gel, a textured fabric skin, a structurally rigid body, and a calibration process that maintains homogeneous illumination and contrast of the tactile images during use. Finally, we evaluate the sensor's durability along four metrics that track the signal quality during more than 3000 grasping experiments.

Robotics
Large-Scale Integrated Flexible Tactile Sensor Array for Sensitive Smart Robotic Touch

Zhenxuan Zhao,Jianshi Tang,Jian Yuan,Yijun Li,Yuan Dai,Jian Yao,Qingtian Zhang,Sanchuan Ding,Tingyu Li,Ruirui Zhang,Yu Zheng,Zhengyou Zhang,Song Qiu,Qingwen Li,Bin Gao,Ning Deng,He Qian,Fei Xing,Zheng You,Huaqiang Wu

DOI: https://doi.org/10.1021/acsnano.2c06432

IF: 17.1

2022-09-28

ACS Nano

Abstract:In the long pursuit of smart robotics, it has been envisioned to empower robots with human-like senses, especially vision and touch. While tremendous progress has been made in image sensors and computer vision over the past decades, tactile sense abilities are lagging behind due to the lack of large-scale flexible tactile sensor array with high sensitivity, high spatial resolution, and fast response. In this work, we have demonstrated a 64 × 64 flexible tactile sensor array with a record-high...

materials science, multidisciplinary,chemistry, physical,nanoscience & nanotechnology
High-Performance Four-Channel Tactile Sensor for Measuring the Magnitude and Orientation of Forces

Mingyao Zhang,Yong Shi,Haitao Ge,Guopeng Sun,Zihan Lian,Yifei Lu

DOI: https://doi.org/10.3390/s24092808

IF: 3.9

2024-04-29

Sensors

Abstract:Flexible sensors have gained popularity in recent years. This study proposes a novel structure of a resistive four-channel tactile sensor capable of distinguishing the magnitude and direction of normal forces acting on its sensing surface. The sensor uses EcoflexTM00-30 as the substrate and EGaIn alloy as the conductive filler, featuring four mutually perpendicular and curved channels to enhance the sensor's dynamic responsiveness. Experiments and simulations show that the sensor has a large dynamic range (31.25–100 mΩ), high precision (deviation of repeated pressing below 0.1%), linearity (R2 above 0.97), fast response/recovery time (0.2 s/0.15 s), and robust stability (with fluctuations below 0.9%). This work uses an underactuated robotic hand equipped with a four-channel tactile sensor to grasp various objects. The sensor data collected effectively predicts the shapes of the objects grasped. Furthermore, the four-channel tactile sensor proposed in this work may be employed in smart wearables, medical diagnostics, and other industries.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Printed Soft Sensor with Passivation Layers for the Detection of Object Slippage by a Robotic Gripper

Reo Miura,Tomohito Sekine,Yi-Fei Wang,Jinseo Hong,Yushi Watanabe,Keita Ito,Yoshinori Shouji,Yasunori Takeda,Daisuke Kumaki,Fabrice Domingues Dos Santos,Atsushi Miyabo,Shizuo Tokito

DOI: https://doi.org/10.3390/mi11100927

IF: 3.4

2020-10-08

Micromachines

Abstract:Tactile sensing, particularly the detection of object slippage, is required for skillful object handling by robotic grippers. The real-time measurement and identification of the dynamic shear forces that result from slippage events are crucial for slip detection and effective object interaction. In this study, a ferroelectric polymer-based printed soft sensor for object slippage detection was developed and fabricated by screen printing. The proposed sensor demonstrated a sensitivity of 8.2 μC·cm−2 and was responsive to shear forces applied in both the parallel and perpendicular directions. An amplifier circuit, based on a printed organic thin-film transistor, was applied and achieved a high sensitivity of 0.1 cm2/V·s. Therefore, this study experimentally demonstrates the effectiveness of the proposed printable high-sensitivity tactile sensor, which could serve as part of a wearable robotic e-skin. The sensor could facilitate the production of a system to detect and prevent the slippage of objects from robotic grippers.

chemistry, analytical,nanoscience & nanotechnology,instruments & instrumentation,physics, applied
High Resolution Tactile Sensors for Curved Robotic Fingertips

Alin Drimus,Vince Jankovics,Matija Gorsic,Stefan Mátéfi-Tempfli

DOI: https://doi.org/10.1007/978-3-319-09435-9_37

2014-01-01

Abstract:Tactile sensing is a key element for various animals that interact with the environment and surrounding objects. Touch provides information about contact forces, torques and pressure distribution and by the means of exploration it provides object properties such as geometry, stiffness and texture[5]. For humans, extracting high level information from touch provides a better understanding of the objects manipulated while for insects it is essential for locomotion[3]. While robot designers have been using vision systems to provide the robot with information about its surroundings, this is not always trivial to obtain, dealing with limited accuracy, occlusions and calibration problems. In terms of sensors for static stimuli, such as pressure, there are a range of technologies that can be used to manufacture transducers with various results[5]. A simple approach is to use fingertips with a 6-DOF force-torque sensor for estimating contact conditions[1], but this only allows a single point of contact and is costly. In terms of fingertip and foot tip prototypes, tactile sensors are used for multi modal sensing, similar to biology, for pressure and dynamic stimuli. In this respect Hosoda et al. [4] propose an anthropomorphic fingertip which has randomly distributed straingauges and PVDF (polyvinylidene fluoride) transducers. In [7] a biomimetic tactile array is proposed that shows a low hysteresis and good sensitivity for skin like deformations.
A robotic sensory system with high spatiotemporal resolution for texture recognition

Ningning Bai,Yiheng Xue,Shuiqing Chen,Lin Shi,Junli Shi,Yuan Zhang,Xingyu Hou,Yu Cheng,Kaixi Huang,Weidong Wang,Jin Zhang,Yuan Liu,Chuan Fei Guo

DOI: https://doi.org/10.1038/s41467-023-42722-4

2023-11-14

Abstract:Humans can gently slide a finger on the surface of an object and identify it by capturing both static pressure and high-frequency vibrations. Although modern robots integrated with flexible sensors can precisely detect pressure, shear force, and strain, they still perform insufficiently or require multi-sensors to respond to both static and high-frequency physical stimuli during the interaction. Here, we report a real-time artificial sensory system for high-accuracy texture recognition based on a single iontronic slip-sensor, and propose a criterion-spatiotemporal resolution, to corelate the sensing performance with recognition capability. The sensor can respond to both static and dynamic stimuli (0-400 Hz) with a high spatial resolution of 15 μm in spacing and 6 μm in height, together with a high-frequency resolution of 0.02 Hz at 400 Hz, enabling high-precision discrimination of fine surface features. The sensory system integrated on a prosthetic fingertip can identify 20 different commercial textiles with a 100.0% accuracy at a fixed sliding rate and a 98.9% accuracy at random sliding rates. The sensory system is expected to help achieve subtle tactile sensation for robotics and prosthetics, and further be applied to haptic-based virtual reality and beyond.
Soft, All‐Polymer Optoelectronic Tactile Sensor for Stick‐Slip Detection

Michael Seokyoung Han,Cindy K. Harnett

DOI: https://doi.org/10.1002/admt.202200406

IF: 6.8

2022-07-26

Advanced Materials Technologies

Abstract:A flexible optical lightguide is built in a skin‐like soft silicone material as an afferent nerve fiber for tactile sensing. Based on a bristle friction model and inter‐fiber gap design, this sensor can measure not only normal force but also stick‐slip events caused by lateral force. Through a cost‐effective and simple fabrication process, validity of the design is demonstrated. The mechanoreceptors of the human tactile sensory system contribute to natural grasping manipulations in everyday life. However, in the case of robot systems, attempts to emulate humans' dexterity are still limited by tactile sensory feedback. In this work, a soft optical lightguide is applied as an afferent nerve fiber in a tactile sensory system. A skin‐like soft silicone material is combined with a bristle friction model, which is capable of fast and easy fabrication. Due to this novel design, the soft sensor can provide not only normal force (up to 5 Newtons) but also lateral force information generated by stick‐slip processes. Through a static force test and slip motion test, its ability to measure normal forces and to detect stick‐slip events is demonstrated. Finally, using a robotic gripper, real‐time control applications are investigated where the sensor helps the gripper apply sufficient force to grasp objects without slipping.

materials science, multidisciplinary

Scalable tactile sensor arrays on flexible substrates with high spatiotemporal resolution enabling slip and grip for closed-loop robotics

Flexible Tactile Sensor Array for Distributed Tactile Sensing and Slip Detection in Robotic Hand Grasping

A Flexible Tactile Sensor Array Based on Pressure Conductive Rubber for Contact Force Measurement and Slip Detection

Finger‐Skin‐Inspired Flexible Optical Sensor for Force Sensing and Slip Detection in Robotic Grasping

Flexible Tactile Sensor Array for Slippage and Grooved Surface Recognition in Sliding Movement

A Flexible Capacitive Tactile Sensor Array for Prosthetic Hand Real-Time Contact Force Measurement.

Development of Fully Flexible Tactile Pressure Sensor with Bilayer Interlaced Bumps for Robotic Grasping Applications.

A Flexible Tactile Sensor Array Based On Pressure Conductive Rubber For Three-Axis Force And Slip Detection

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Development of Flexible Tactile Sensor for the Envelop of Curved Robotic Hand Finger in Grasping Force Sensing

Optical and electrical dual-mode tactile sensor with interlinked interfaces recording normal force and slip for closed-loop robotics

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

A Novel Tactile Sensing Array with Elastic Steel Frame Structure for Prosthetic Hand.

Large-Area and Low-Cost Force/Tactile Capacitive Sensor for Soft Robotic Applications

GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Finger

Large-Scale Integrated Flexible Tactile Sensor Array for Sensitive Smart Robotic Touch

High-Performance Four-Channel Tactile Sensor for Measuring the Magnitude and Orientation of Forces

Printed Soft Sensor with Passivation Layers for the Detection of Object Slippage by a Robotic Gripper

High Resolution Tactile Sensors for Curved Robotic Fingertips

A robotic sensory system with high spatiotemporal resolution for texture recognition

Soft, All‐Polymer Optoelectronic Tactile Sensor for Stick‐Slip Detection