Costs of venom production in the common death adder (Acanthophis antarcticus).

Anna F. V. Pintor,A. Krockenberger,J. Seymour

DOI: https://doi.org/10.1016/j.toxicon.2010.07.008

IF: 3.035

2010-11-01

Toxicon

Abstract:

What problem does this paper attempt to address?

Optical Micro/Nanofiber-Enabled Compact Tactile Sensor for Hardness Discrimination.

Yao Tang,Haitao Liu,Jing Pan,Zhang,Yue Xu,Ni Yao,Lei Zhang,Limin Tong

DOI: https://doi.org/10.1021/acsami.0c20392

IF: 9.5

2021-01-01

ACS Applied Materials & Interfaces

Abstract:Optical micro/nanofibers (MNFs) can be applied for ultrasensitive tactile sensing with fast response and compact size, which are attractive for restoring tactile information in minimally invasive robotic surgery and tissue palpation. Herein, we present a compact tactile sensor (CTS) with a diameter of 1.5 mm enabled by an optical MNF. The CTS provides continuous readouts for high-fidelity transduction of touch and pressure stimuli into interpretable optical signals, which permit instantaneous sensing of contact and pressure with pressure-sensing sensitivity as high as 0.108 mN-1 and a resolution of 0.031 mN. Working in pressing mode, the CTS can discriminate the difference in the hardness of two poly(dimethylsiloxane) (PDMS) slats (with shore A of 36 and 40) directly, a hardness resolving ability even beyond the human hands. Benefitting from the fast response feature, the CTS can also be operated in either scanning or tapping mode, making it feasible for hardness identification by analyzing the shape of the response curve. As a proof of concept, the hardness discrimination of a pork liver and an adductor muscle was experimentally demonstrated. Such MNF-enabled compact tactile sensors may pave the way for hardness sensing in tissue palpation, surgical robotics, and object identification.
Tactile Evaluation Feedback System for Multi-Layered Structure Inspired by Human Tactile Perception Mechanism

Iza Husna Mohamad Hashim,Shogo Kumamoto,Kenjiro Takemura,Takashi Maeno,Shin Okuda,Yukio Mori

DOI: https://doi.org/10.3390/s17112601

IF: 3.9

2017-11-11

Sensors

Abstract:Tactile sensation is one type of valuable feedback in evaluating a product. Conventionally, sensory evaluation is used to get direct subjective responses from the consumers, in order to improve the product's quality. However, this method is a time-consuming and costly process. Therefore, this paper proposes a novel tactile evaluation system that can give tactile feedback from a sensor's output. The main concept of this system is hierarchically layering the tactile sensation, which is inspired by the flow of human perception. The tactile sensation is classified from low-order of tactile sensation (LTS) to high-order of tactile sensation (HTS), and also to preference. Here, LTS will be correlated with physical measures. Furthermore, the physical measures that are used to correlate with LTS are selected based on four main aspects of haptic information (roughness, compliance, coldness, and slipperiness), which are perceived through human tactile sensors. By using statistical analysis, the correlation between each hierarchy was obtained, and the preference was derived in terms of physical measures. A verification test was conducted by using unknown samples to determine the reliability of the system. The results showed that the system developed was capable of estimating preference with an accuracy of approximately 80%.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Tactile Rendering of Fabric Textures Based on Texture Recognition

Yixin Chen,Wenying Qiu,Xiaohao Wang,Min Zhang

DOI: https://doi.org/10.1109/NSENS49395.2019.9293989

2019-01-01

Abstract:A tactile rendering system for fabric textures is presented to improve the tactile sensations in humancomputer interactions in this paper. A tactile platform based on electrovibration is constructed to produce the virtual tactile sensation. The voltage amplitude perception threshold and differential threshold of human beings on the system are measured by a series of experiments. On this basis, the relationship between the stimulus signal and tactile perception is established using psychophysical experiments. A texture library of fabrics is then created by using a surface morphology analyzer. The amplitude of the corresponding voltage for rendering textures can be calculated according to the established relationship between the stimulus signal and tactile perception. As a new fabric texture image is input to the system, convolutional neural network (CNN) is used to match the texture with the texture library and then the corresponding stimulus signal can be generated. The above system is finally evaluated and numerically quantified through experiments.
An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition

Rasouli,Yi Chen,Arindam Basu,Sunil L. Kukreja,Nitish V. Thakor,Mahdi Rasouli

DOI: https://doi.org/10.1109/tbcas.2018.2805721

2018-04-01

IEEE Transactions on Biomedical Circuits and Systems

Abstract:Despite significant advances in computational algorithms and development of tactile sensors, artificial tactile sensing is strikingly less efficient and capable than the human tactile perception. Inspired by efficiency of biological systems, we aim to develop a neuromorphic system for tactile pattern recognition. We particularly target texture recognition as it is one of the most necessary and challenging tasks for artificial sensory systems. Our system consists of a piezoresistive fabric material as the sensor to emulate skin, an interface that produces spike patterns to mimic neural signals from mechanoreceptors, and an extreme learning machine (ELM) chip to analyze spiking activity. Benefiting from intrinsic advantages of biologically inspired event-driven systems and massively parallel and energy-efficient processing capabilities of the ELM chip, the proposed architecture offers a fast and energy-efficient alternative for processing tactile information. Moreover, it provides the opportunity for the development of low-cost tactile modules for large-area applications by integration of sensors and processing circuits. We demonstrate the recognition capability of our system in a texture discrimination task, where it achieves a classification accuracy of 92% for categorization of ten graded textures. Our results confirm that there exists a tradeoff between response time and classification accuracy (and information transfer rate). A faster decision can be achieved at early time steps or by using a shorter time window. This, however, results in deterioration of the classification accuracy and information transfer rate. We further observe that there exists a tradeoff between the classification accuracy and the input spike rate (and thus energy consumption). Our work substantiates the importance of development of efficient sparse codes for encoding sensory data to improve the energy efficiency. These results have a significance for a wide range of wearable, robotic, prosthetic, and industrial applications.

engineering, biomedical, electrical & electronic
A Skin-Inspired PDMS Optical Tactile Sensor Driven by a Convolutional Neural Network

Shichao Yue,Minzhi Xu,Zifan Che

DOI: https://doi.org/10.1109/jsen.2024.3355555

IF: 4.3

2024-03-15

IEEE Sensors Journal

Abstract:Tactile sensors play a crucial role in enhancing the integration of automation, robotics, and biomedical equipment, particularly in perceptual functions. Optical fiber-based tactile sensors have gained significance due to their robustness and immunity to electromagnetic interference. However, existing optical fiber-based tactile sensors face limitations related to bio-imitation, scalability, and precise data processing algorithms. This study introduces a novel skin-inspired polydimethylsiloxane (PDMS)-manufactured tactile sensor utilizing a structured light source with low-cost light-emitting diodes and a multimode optical fiber, coupled with tactile information processing through a trained convolutional neural network (CNN). Specklegram images captured from the optical fiber are analyzed for force amplitude and tactile location. The CNN is trained, validated, and tested, achieving accuracies of 99.6%, 99.5%, and 99%, respectively. The tactile sensor demonstrates a spatial resolution of 2 mm and a force-sensing range up to 3 N. The confusion matrix, based on classification results, reveals only three misclassifications out of 315 tests, indicating a mean absolute error (MAE) of 0.95%. The spatial resolution and force-sensing capabilities, coupled with the machine learning approach of the proposed tactile sensor, showcase promising potential for future applications in tactile embodiment.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
A Bio‐Inspired Artificial Tactile Sensing System Based on Optical Microfiber and Enhanced by Neural Network

Junjie Weng,Siyang Xiao,Yang Yu,Jianfa Zhang,Jian Chen,Dongying Wang,Zhencheng Wang,Jianqiao Liang,Hansi Ma,Junbo Yang,Tianwu Wang,Zhenrong Zhang

DOI: https://doi.org/10.1002/adsr.202300157

2024-04-18

Advanced Sensor Research

Abstract:Inspired by human tactual mechanism, a bio‐inspired artificial tactile (BAT) sensing system is presented, which consists of the BAT sensor and the full‐connected neural network (FCNN). BAT sensor mimics the human skin for sensing tactile stimuli with the highest sensitivity of −7.11 V N−1, and FCNN functions as the simulated human brain for intelligent tactile perception with an identification accuracy of 95.7%. Human tactile perception involves the activation of mechanoreceptors located within the skin in response to external stimuli, along with the organization and processing within the brain. However, human sensations may be subject to the issues related to some physiological factors (such as skin injury or neurasthenia), resulting in inability to quantify tactile information. To address this challenge, a novel bio‐inspired artificial tactile (BAT) sensing system enabled by the integration of optical microfiber (OM) with full‐connected neural network (FCNN) in this paper is demonstrated, inspired by human physiological characteristics and tactile mechanisms. In this system, the BAT sensor mimics human skin, where the OM serves as the mechanoreceptor for sensing tactile stimuli, while the FCNN functions as a simulated human brain to train and extract the signal characteristics for intelligent object recognition. The experimental results indicate that the proposed BAT sensor can sensitively respond to both the contact force (static tactile stimuli), as well as the vibrotactile events (dynamic tactile stimuli) for the recognition of regular textures. Furthermore, by integrating the trained FCNN, the BAT sensing system accurately identifies various intricate surface textures with an exceptional accuracy of 95.7%, highlighting its potential in next‐generation human‐machine interaction and advanced robotics.
Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor

Carmelo Sferrazza,Raffaello D'Andrea,Raffaello D’Andrea

DOI: https://doi.org/10.3390/s19040928

IF: 3.9

2019-02-22

Sensors

Abstract:Human skin is capable of sensing various types of forces with high resolution and accuracy. The development of an artificial sense of touch needs to address these properties, while retaining scalability to large surfaces with arbitrary shapes. The vision-based tactile sensor proposed in this article exploits the extremely high resolution of modern image sensors to reconstruct the normal force distribution applied to a soft material, whose deformation is observed on the camera images. By embedding a random pattern within the material, the full resolution of the camera can be exploited. The design and the motivation of the proposed approach are discussed with respect to a simplified elasticity model. An artificial deep neural network is trained on experimental data to perform the tactile sensing task with high accuracy for a specific indenter, and with a spatial resolution and a sensing range comparable to the human fingertip.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Xiang Fu,Jiqiang Zhang,Jianliang Xiao,Yuran Kang,Longteng Yu,Chengpeng Jiang,Yuxiang Pan,Hao Dong,Shuaikang Gao,Yancheng Wang

DOI: https://doi.org/10.1039/d1nr03265h

IF: 6.7

2021-01-01

Nanoscale

Abstract:Tactile sensors are of great significance for robotic perception improvement to realize stable object manipulation and accurate object identification. To date, developing a broad-range tactile sensor array with high sensitivity economically remains a critical challenge. In this study, a flexible capacitive tactile sensor array, consisting of a carbon nanotube (CNT)/polydimethylsiloxane (PDMS) film, parylene films, and two polyimide (PI) films patterned with electrodes, is facilely prepared. The CNT/PDMS film, acting as a giant dielectric permittivity material, is utilized to improve the sensitivity, while the parylene film serves as the scaffold architecture to extend the working range of the tactile sensor array. Also, it is promising to realize mass production for this sensor array due to the scalable fabrication procedure. The as-prepared sensor exhibits excellent sensing performance with a high sensitivity of 1.61% kPa-1 (<1 MPa), an ultra-broad pressure working range of 0.9 kPa-2.55 MPa, an outstanding durability, a stability up to 5000 cycles, and a fast response time. By integrating our tactile sensor array with a robotic gripper, we show that robots can successfully differentiate object shapes and manipulate light and heavy objects with a closed-loop pressure feedback, demonstrating its great potential in robotic perception and wearable applications.
Denial of Service (DoS)

G. Portokalidis

DOI: https://doi.org/10.1007/978-1-4419-5906-5_1063

Abstract:
Recognition of surface texture with wearable tactile sensor array: A pilot Study

Yancheng Wang,Jianing Chen,Deqing Mei

DOI: https://doi.org/10.1016/j.sna.2020.111972

2020-01-01

Abstract:Discrimination of surface textures and their surface roughness using tactile sensors have attracted increasing attention. Highly sensitive tactile sensors with the ability to recognize and discriminate the surface textures and roughness of grasped objects are crucial for intelligent robotics. This paper presents a methodology by using the developed WMB model (W-M function and Beam-Bundle Theory) and an algorithm based on artificial neural network to study the performance of a flexible tactile sensor for surface texture classification. For the WMB model, the quasi-3D surfaces of specific objects are reconstructed based on W-M function and basic statistical theory. A simplified Beam-Bundle Model is utilized to represent the cover layer of the sensor and simulates the normal force fluctuations during sliding movements. According to the simulation results, surface textures can be classified by the characteristic frequency cluster (CFC) existing in the fluctuation of curve's spectrum. As an experiment, an artificial neural network is established to classify surface textures based on voltage signals from the tactile sensor. An MAF array represents the CFC information and improves the classification accuracy from 78 % to 82 %. The results demonstrate the effectiveness of the proposed WMB model and that it provides a new method of analysis involving robotic tactile interactions. (C) 2020 Elsevier B.V. All rights reserved.
Texture recognition based on magnetostrictive tactile sensor array and convolutional neural network

Zhuolin Li,Ling Weng,Yuanye Zhang,Kaile Liu,Yang Liu

DOI: https://doi.org/10.1063/5.0164170

IF: 1.697

2023-10-01

AIP Advances

Abstract:Tactile sensors are key devices in surface information perception for robots that can recognize the surface texture of fabrics with different materials and winding patterns in unstructured environments, thus helping the robot process fabrics more effectively. In this study, a magnetostrictive tactile sensor array was designed and loaded onto the robotic fingertips, and the output voltage waveform was obtained by manipulating the sensor array to slide in contact with fabrics. The output voltage waveform diagram was normalized to build the FTS-15 tactile texture dataset. The convolutional neural network ResNet-18 model was built to pre-process the dataset, and the accuracy of recognizing 15 fabrics reached 97.95%. The results show that this texture recognition method can be effectively applied to the field of fabric texture recognition.

materials science, multidisciplinary,physics, applied,nanoscience & nanotechnology
Deep Tactile Experience: Estimating Tactile Sensor Output from Depth Sensor Data

Karankumar Patel,Soshi Iba,Nawid Jamali

DOI: https://doi.org/10.48550/arXiv.2110.08946

IF: 3.7

2021-10-17

Robotics

Abstract:Tactile sensing is inherently contact based. To use tactile data, robots need to make contact with the surface of an object. This is inefficient in applications where an agent needs to make a decision between multiple alternatives that depend the physical properties of the contact location. We propose a method to get tactile data in a non-invasive manner. The proposed method estimates the output of a tactile sensor from the depth data of the surface of the object based on past experiences. An experience dataset is built by allowing the robot to interact with various objects, collecting tactile data and the corresponding object surface depth data. We use the experience dataset to train a neural network to estimate the tactile output from depth data alone. We use GelSight tactile sensors, an image-based sensor, to generate images that capture detailed surface features at the contact location. We train a network with a dataset containing 578 tactile-image to depthmap correspondences. Given a depth-map of the surface of an object, the network outputs an estimate of the response of the tactile sensor, should it make a contact with the object. We evaluate the method with structural similarity index matrix (SSIM), a similarity metric between two images commonly used in image processing community. We present experimental results that show the proposed method outperforms a baseline that uses random images with statistical significance getting an SSIM score of 0.84 +/- 0.0056 and 0.80 +/- 0.0036, respectively.
Ultrasensitive Skin-Like Wearable Optical Sensors Based on Glass Micro/nanofibers

Lei Zhang,Jing Pan,Zhang,Hao Wu,Ni Yao,Dawei Cai,Yingxin Xu,Jin Zhang,Guofei Sun,Liqiang Wang,Weidong Geng,Wenguang Jin,Wei Fang,Dawei Di,Limin Tong

DOI: https://doi.org/10.29026/oea.2020.190022

IF: 8.9329

2020-01-01

Opto-Electronic Advances

Abstract:Electronic skin, a class of wearable electronic sensors that mimic the functionalities of human skin, has made remarkable success in applications including health monitoring, human-machine interaction and electronic-biological interfaces. While electronic skin continues to achieve higher sensitivity and faster response, its ultimate performance is fundamen-tally limited by the nature of low-frequency AC currents. Herein, highly sensitive skin-like wearable optical sensors are demonstrated by embedding glass micro/nanofibers (MNFs) in thin layers of polydimethylsiloxane (PDMS). Enabled by the transition from guided modes into radiation modes of the waveguiding MNFs upon external stimuli, the skin-like opti-cal sensors show ultrahigh sensitivity (1870 kPa-1), low detection limit (7 mPa) and fast response (10 μs) for pressure sensing, significantly exceeding the performance metrics of state-of-the-art electronic skins. Electromagnetic interference (EMI)-free detection of high-frequency vibrations, wrist pulse and human voice are realized. Moreover, a five-sensor op-tical data glove and a 2×2-MNF tactile sensor are demonstrated. These initial results pave the way toward a new cate-gory of optical devices ranging from ultrasensitive wearable sensors to optical skins.
Hierarchical Tactile Sensation Integration from Prosthetic Fingertips Enables Multi-Texture Surface Recognition

Moaed A Abd,Rudy Paul,Aparna Aravelli,Ou Bai,Leonel Lagos,Maohua Lin,Erik D Engeberg

DOI: https://doi.org/10.3390/s21134324

2021-06-24

Abstract:Multifunctional flexible tactile sensors could be useful to improve the control of prosthetic hands. To that end, highly stretchable liquid metal tactile sensors (LMS) were designed, manufactured via photolithography, and incorporated into the fingertips of a prosthetic hand. Three novel contributions were made with the LMS. First, individual fingertips were used to distinguish between different speeds of sliding contact with different surfaces. Second, differences in surface textures were reliably detected during sliding contact. Third, the capacity for hierarchical tactile sensor integration was demonstrated by using four LMS signals simultaneously to distinguish between ten complex multi-textured surfaces. Four different machine learning algorithms were compared for their successful classification capabilities: K-nearest neighbor (KNN), support vector machine (SVM), random forest (RF), and neural network (NN). The time-frequency features of the LMSs were extracted to train and test the machine learning algorithms. The NN generally performed the best at the speed and texture detection with a single finger and had a 99.2 ± 0.8% accuracy to distinguish between ten different multi-textured surfaces using four LMSs from four fingers simultaneously. The capability for hierarchical multi-finger tactile sensation integration could be useful to provide a higher level of intelligence for artificial hands.
Design a Multifunctional Soft Tactile Sensor Enhanced by Machine Learning Approaches

Wu-Te Yang,Masayoshi Tomizuka

DOI: https://doi.org/10.1115/1.4054646

2022-06-10

Abstract:Abstract Tactile sensors are essential to robot hands that deal with various objects and interact with the environment. Soft tactile sensors are especially important to capture tactile information about delicate, irregular-shaped, or unknown objects. This paper introduces a soft tactile sensor that can simultaneously estimate the contact force, contact feature, and contact point. Inspired by multifunctional human skin, the proposed design has a dual-layer structure and is multifunctional. The top layer consists of a group of sensing elements that detect the contact location and contact feature enhanced by the bagging classifier based on the k-nearest neighbors. The sensor elements were biomimetically and analytically designed as a pyramid shape that mimicked the mountain ridge-like structure in human skin to improve sensitivity. The bottom layer was made by a piece of Velostat sandwiched between conductive fabrics that can measure the contact force. The relationship between the sensing voltage and the contact force was modeled by the Nadaraya–Watson regressor. The performance of the proposed sensor was verified by a repeatability test. Furthermore, we demonstrated the effectiveness of the proposed sensor on a robotic gripper. The experimental results show that this sensor is able to detect contact information of fragile objects.

automation & control systems,instruments & instrumentation
Multimodal Surface Sensing Based on Hybrid Flexible Triboelectric and Piezoresistive Sensor.

Zenan Lin,Kai-Chong Lei,Shilong Mu,Ziwu Song,Yuan Dai,Wenbo Ding,Xiao-Ping Zhang

DOI: https://doi.org/10.1145/3544793.3560404

2022-01-01

Abstract:Sensing the surface properties through touch, as the most natural perceptual way of humans, has become an important and practical method for human-machine interactions (HMI) and robot manipulations. In this paper, we design a fingertip hybrid flexible tactile sensor for multimodal surface sensing, based on the triboelectric and piezoresistive mechanisms. A real-time tactile sensing system is implemented on a 3D-printed robot finger together with a wireless data acquisition board. A virtual data generation method is proposed to expand the model adaptability under different compression force levels. Moreover, considering the characteristics of data generated by our sensors, a novel deep learning model with a residual structure is developed, named parallel residual convolutional neural network (PR-CNN). Our model outperforms the state-of-the-art models, i.e., Res-CNN, LSTM-FCN and InceptionTime, with over 96% accuracy, on three classification tasks, including textures (13 types), materials (10 types), and combinations of textures and materials (18 types). The proposed system has broad applications in service robots, industrial sorting robots, and HMI.
Wearable Mechanotransduced Tactile Sensor for Haptic Perception

Joo Chuan Yeo,Zhuangjian Liu,Zhi‐Qian Zhang,Pan Zhang,Zhiping Wang,Chwee Teck Lim,Zhi-Qian Zhang

DOI: https://doi.org/10.1002/admt.201700006

IF: 6.8

2017-04-18

Advanced Materials Technologies

Abstract:Haptic tactile acuity is an important element for object recognition and manipulation. However, ascribing tactile acuity unto artificial systems is extremely challenging, as it requires active touch exploration involving multidirectional manipulation and sensing. This work reports a skin‐inspired liquid‐based microfluidic tactile sensor capable of haptic perception. The tactile sensor comprises a uniquely designed elastomeric structure with a microfluidic protrusion. Multidirectional forces on the protrusion result in unique fluid displacement that can be measured electrically. This unique architecture is sensitive enough to discriminate surface changes below 0.5 mm. Our sensor is thin, flexible, and robust, allowing adhesion to skin to directly discriminate surface features, contour changes, and object stiffness. We further show a proof of concept of our wearable tactile sensor for Braille reading, enabling the identification of letters by scanning across standard Braille codes. This technology has potential in enabling haptic perception for users affected by sensory neuropathy or for implementation in medical, social, and assistive robotics. A wearable mechanotransduced tactile sensor capable of haptic perception is developed. The 3D sensor perceives texture through the detection of both normal and shear forces induced by the displacement of the conductive liquid metallic alloy within it. The integrated tactile sensor system can also be worn to perform real‐time Braille reading.

materials science, multidisciplinary
A Vision-Based Tactile Sensing System for Multimodal Contact Information Perception via Neural Network

Weiliang Xu,Guoyuan Zhou,Yuanzhi Zhou,Zhibin Zou,Jiali Wang,Wenfeng Wu,Xinming Li

2024-03-06

Abstract:In general, robotic dexterous hands are equipped with various sensors for acquiring multimodal contact information such as position, force, and pose of the grasped object. This multi-sensor-based design adds complexity to the robotic system. In contrast, vision-based tactile sensors employ specialized optical designs to enable the extraction of tactile information across different modalities within a single system. Nonetheless, the decoupling design for different modalities in common systems is often independent. Therefore, as the dimensionality of tactile modalities increases, it poses more complex challenges in data processing and decoupling, thereby limiting its application to some extent. Here, we developed a multimodal sensing system based on a vision-based tactile sensor, which utilizes visual representations of tactile information to perceive the multimodal contact information of the grasped object. The visual representations contain extensive content that can be decoupled by a deep neural network to obtain multimodal contact information such as classification, position, posture, and force of the grasped object. The results show that the tactile sensing system can perceive multimodal tactile information using only one single sensor and without different data decoupling designs for different modal tactile information, which reduces the complexity of the tactile system and demonstrates the potential for multimodal tactile integration in various fields such as biomedicine, biology, and robotics.

Robotics
A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network.

Chao Yang,Fuchun Sun,Bin Fang,Luxuan Li

DOI: https://doi.org/10.1007/978-981-10-5230-9_34

2017-01-01

Abstract:In this paper, we design a vision-based tactile sensor which can capture the two-dimensional deformation images when stressed. The sensor mainly consists of a transparent elastomer, a 4x4 or 8x8 array of single layer markers on the surface of the elastomer and a camera which is used to capture the markers. According to Hooke's law, we propose a scheme using the nonlinear fitting and activation function of neural network with three layers to fit stiffness coefficient of elastomer, then we can calculate the three-dimensional tactile information. Compared to the tactile sensor with two layers having markers of different colors, our method has the advantage of simpler manufacturing process. Besides, it does not need expensive camera and precise focusing process, which is necessary for DFD (Depth from defocus) algorithm to calculate depth displacement information of markers. Further more, our method adapts neural network to fit the stiffness coefficient of elastomer, making the parameters have physical significance, which accords with the physical properties of elastomer. The sensor can reconstruct three-dimensional tactile information in real time with a speed of about 30fps.
Open‐Environment Tactile Sensing System: Towards Simple and Efficient Material Identification

Xuelian Wei,Baocheng Wang,Zhiyi Wu,Zhong Lin Wang

DOI: https://doi.org/10.1002/adma.202203073

IF: 29.4

2022-05-18

Advanced Materials

Abstract:Robotic perception can have simple and effective sensing functions that are unreachable for humans using only the isolated tactile perception method, with the assistance of triboelectric nanogenerator (TENG). However, the reliability of triboelectric sensors remains a major challenge due to the inherent environmental limitations. Here, an intelligent tactile sensing system that combines TENG and deep learning technology is proposed. Using a triboelectric triple tactile sensor (TTS) array, typical characteristics of each testing material can be maintained stably even under different contact conditions (touch conditions and external environmental conditions) by extracting features from three independent electrical signals as well as the normalized output signals. Furthermore, a convolutional neural network (CNN) model is integrated, and a high accuracy of 96.62% is achieved in a material identification task. Our tactile sensing system has been exhibited to an open environment for material identification and the real‐time demonstration. Compared to the complex process that humans must integrate multiple sensing (touching and viewing) to accomplish tactile perception, the proposed sensing system shows a huge advantage in cognitive learning for the visually impaired, biomimetic prosthetics, and virtual spaces construction. This article is protected by copyright. All rights reserved

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology

Costs of venom production in the common death adder (Acanthophis antarcticus).

Optical Micro/Nanofiber-Enabled Compact Tactile Sensor for Hardness Discrimination.

Tactile Evaluation Feedback System for Multi-Layered Structure Inspired by Human Tactile Perception Mechanism

Tactile Rendering of Fabric Textures Based on Texture Recognition

An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition

A Skin-Inspired PDMS Optical Tactile Sensor Driven by a Convolutional Neural Network

A Bio‐Inspired Artificial Tactile Sensing System Based on Optical Microfiber and Enhanced by Neural Network

Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Denial of Service (DoS)

Recognition of surface texture with wearable tactile sensor array: A pilot Study

Texture recognition based on magnetostrictive tactile sensor array and convolutional neural network

Deep Tactile Experience: Estimating Tactile Sensor Output from Depth Sensor Data

Ultrasensitive Skin-Like Wearable Optical Sensors Based on Glass Micro/nanofibers

Hierarchical Tactile Sensation Integration from Prosthetic Fingertips Enables Multi-Texture Surface Recognition

Design a Multifunctional Soft Tactile Sensor Enhanced by Machine Learning Approaches

Multimodal Surface Sensing Based on Hybrid Flexible Triboelectric and Piezoresistive Sensor.

Wearable Mechanotransduced Tactile Sensor for Haptic Perception

A Vision-Based Tactile Sensing System for Multimodal Contact Information Perception via Neural Network

A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network.

Open‐Environment Tactile Sensing System: Towards Simple and Efficient Material Identification