Textiles for Learning Tactile Interactions

Guorui Chen,Yunsheng Fang,Xun Zhao,Trinny Tat,Jun Chen

DOI: https://doi.org/10.1038/s41928-021-00560-6

IF: 33.255

2021-01-01

Nature Electronics

Abstract:n AI-assisted smart textile can be used to record, model and understand human–environment interactions.

What problem does this paper attempt to address?

Learning human–environment interactions using conformal tactile textiles

Yiyue Luo,Yunzhu Li,Pratyusha Sharma,Wan Shou,Kui Wu,Michael Foshey,Beichen Li,Tomás Palacios,Antonio Torralba,Wojciech Matusik

DOI: https://doi.org/10.1038/s41928-021-00558-0

IF: 33.255

2021-03-01

Nature Electronics

Abstract:<p>Nature Electronics, Published online: 24 March 2021; <a href="https://www.nature.com/articles/s41928-021-00558-0">doi:10.1038/s41928-021-00558-0</a></p>Large-scale sensing textiles that can conform to arbitrary three-dimensional geometries and are created through digital machine knitting of piezoresistive fibres can be used to record, monitor and learn human–environment interactions.

engineering, electrical & electronic
Intelligent textiles: designing a gesture-controlled illuminated textile based on computer vision

Jeanne Tan,Li Shao,Ngan Yi Kitty Lam,Anne Toomey,Lan Ge

DOI: https://doi.org/10.1177/00405175211034245

IF: 2.3

2021-08-13

Textile Research Journal

Abstract:Artificial intelligence (AI) offers the potential for the development of e-textiles that give wearers a smart and intuitive experience. An emerging challenge in intelligent materials design is hand gesture recognition textiles. Most current research focuses on number gesture recognition via smart gloves, so there is a gap in research that studies contact-less number gesture recognition textiles via computer vision. Meanwhile, there is lack of exploration on the integration of illuminating function and number gesture recognition textiles to improve interactivity by real-time visualizing detection results. In this research, a novel interactive illuminating textile with a touch-less number gesture recognition function has been designed and fabricated by using an open-source AI model. It is used in sync with a polymeric optical fiber textile with illuminative features. The textile is color-changing, controlled by the system's mid-air interactive number gesture recognition capability and has a woven stripe pattern and a double-layer weave structure with open pockets to facilitate integration of the system's components. Also described here is a novel design process that permits textile design and intelligent technology to integrate seamlessly and in synchronization, so that design in effect mediates continuously between the physical textile and the intangible technology. Moreover, this design method serves as a reference for the integration of open-source intelligent hardware and software into e-textiles for enhancement of the intuitive function and value via economy of labor.

materials science, textiles
Design of an Interactive Device Based on e-Textile Material

Xuanzhu Meng,Qiong Wu

DOI: https://doi.org/10.1007/978-3-030-90963-5_6

2021-01-01

Abstract:Electronic textile (or e-Textile) is the material integrating digital information transmission ability and traditional fabric characteristics, which leads to great tactile interaction. However, the current research of the interaction of e-Textile are still influenced by the interaction mode adopted from electronic devices, such as the capacitive touch of the interactive elements. In this paper, we want to focus on how to interact with e-Textile in more textile characteristic ways, and pay more attention to the tactile semantics of materials in the process of interaction design. In order to apply the unique interactive way and interactive ability of e-Textile, this paper designs a group of interactive lighting devices. The lights combined with e-Textile can be used as output information to give feedback to the interactive behavior. The research for different interaction of e-Textile will expand the extension of fabric interaction mode, and tap the great potential of textile material properties in human-computer interaction.
IntelliTex: Fabricating Low-cost and Washable Functional Textiles Using A Double-coating Process

Yuecheng Peng,Danchang Yan,Haotian Chen,Yue Yang,Ye Tao,Weitao Song,Lingyun Sun,Guanyun Wang

DOI: https://doi.org/10.1145/3613904.3642759

2024-01-01

Abstract:We present IntelliTex, a low-cost and highly accessible double-coating fabrication method for washable and reusable functional textiles with customized input functionalities. Specifcally, of-the-shelf textiles are firstly coated with conductive carbon black using pen ink, which endows textiles with rich sensing capabilities, such as pressure, stretch, slide, and temperature. Secondly, textiles are coated with polyurethane to enhance the sensing stability over wash cycles for good reusability. To support user customization, we enrich the design space of double-coating by exploring various coating methods and diverse textiles to be coated. We further contribute a comprehensive library of input components and an online document to make our approach accessible to novice users. Finally, five application examples and a user study showcase the versatile functionalities and user accessibility of our method, with which we hope to support designers, makers, and researchers to easily create functional textiles ready to use in everyday life.
Intelligent Textiles for Visual and Smart Interaction

Yuanyuan Zheng,Zhigang Chen,Huisheng Peng

DOI: https://doi.org/10.1007/s42765-024-00431-7

2024-01-01

Abstract:The fiberization and integration of electronic devices into textiles represent an important strategy to design wearable and comfortable intelligent systems. However, the function realization of existing intelligent textiles often depends on complex and rigid silicon-based computation components, which have posed significant challenges in terms of integration, energy consumption and user comfort. This has spurred the need for a paradigm shift towards more seamless and efficient solutions. The advent of chipless interactive textile electronics presents a promising pathway for overcoming these challenges and unlocking new possibilities in wearable technology.
LayTex: A Design Tool for Generating Customized Textile Sensor Layouts in Wearable Computing

Yueyao Zhang,Nianchong Qu,Runhua Zhang,Ye Tao,Guanyun Wang,Qi Wang

DOI: https://doi.org/10.1145/3594739.3610692

2023-01-01

Abstract:Smart textile sensors have attracted increasing interest in the domain of wearable computing for human motion monitoring. Previous studies have shown that textile sensor layout has a major impact on the effectiveness and performance of wearable prototypes. However, it is still a trick and time-consuming issue to determine textile sensor layout in a quantitative approach as it involves figuring out the number, placement, and even orientations of sensors, yet there is no streamlined digital platform or tool specifically addressing this issue. In this paper, we introduce LayTex, a digital tool capable of generating layout proposals for personalized scenarios, which aims at facilitating designers and researchers to construct prototypes efficiently. The preliminary evaluation with designers on smart garments for scoliosis indicates that LayTex has great potential to lower the barriers and simplify the process of textile prototype construction.
Adaptive tactile interaction transfer via digitally embroidered smart gloves

Yiyue Luo,Chao Liu,Young Joong Lee,Joseph DelPreto,Kui Wu,Michael Foshey,Daniela Rus,Tomás Palacios,Yunzhu Li,Antonio Torralba,Wojciech Matusik

DOI: https://doi.org/10.1038/s41467-024-45059-8

IF: 16.6

2024-01-29

Nature Communications

Abstract:Abstract Human-machine interfaces for capturing, conveying, and sharing tactile information across time and space hold immense potential for healthcare, augmented and virtual reality, human-robot collaboration, and skill development. To realize this potential, such interfaces should be wearable, unobtrusive, and scalable regarding both resolution and body coverage. Taking a step towards this vision, we present a textile-based wearable human-machine interface with integrated tactile sensors and vibrotactile haptic actuators that are digitally designed and rapidly fabricated. We leverage a digital embroidery machine to seamlessly embed piezoresistive force sensors and arrays of vibrotactile actuators into textiles in a customizable, scalable, and modular manner. We use this process to create gloves that can record, reproduce, and transfer tactile interactions. User studies investigate how people perceive the sensations reproduced by our gloves with integrated vibrotactile haptic actuators. To improve the effectiveness of tactile interaction transfer, we develop a machine-learning pipeline that adaptively models how each individual user reacts to haptic sensations and then optimizes haptic feedback parameters. Our interface showcases adaptive tactile interaction transfer through the implementation of three end-to-end systems: alleviating tactile occlusion, guiding people to perform physical skills, and enabling responsive robot teleoperation.

multidisciplinary sciences
TacTex: A Textile Interface with Seamlessly-Integrated Electrodes for High-Resolution Electrotactile Stimulation

Hongnan Lin,Xuanyou Liu,Shengsheng Jiang,Qi Wang,Ye Tao,Guanyun Wang,Wei Sun,Teng Han,Feng Tian

DOI: https://doi.org/10.1145/3613904.3642873

2024-01-01

Abstract:This paper presents TacTex, a textile-based interface that provides high-resolution haptic feedback and touch-tracking capabilities. TacTex utilizes electrotactile stimulation, which has traditionally posed challenges due to limitations in textile electrode density and quantity. TacTex overcomes these challenges by employing a multi-layer woven structure that separates conductive weft and warp electrodes with non-conductive yarns. The driving system for TacTex includes a power supply, sensing board, and switch boards to enable spatial and temporal control of electrical stimuli on the textile, while simultaneously monitoring voltage changes. TacTex can stimulate a wide range of haptic effects, including static and dynamic patterns and different sensation qualities, with a resolution of 512 × 512 and based on linear electrodes spaced as closely as 2mm. We evaluate the performance of the interface with user studies and demonstrate the potential applications of TacTex interfaces in everyday textiles for adding haptic feedback.
All‐Organic Smart Textile Sensor for Deep‐Learning‐Assisted Multimodal Sensing (Adv. Funct. Mater. 30/2023)

Pengfei Zhao,Yilin Song,Peng Xie,Fan Zhang,Tao Xie,Gang Liu,Jiyu Zhao,Su‐Ting Han,Ye Zhou

DOI: https://doi.org/10.1002/adfm.202370186

IF: 19

2023-07-27

Advanced Functional Materials

Abstract:Electronic Textiles In article number 2301816, Ye Zhou and co‐workers report an all‐textile, all‐organic, washable and breathable sensor to realize wide‐range sensing of human activities and noncontact stimuli without sacrificing biocompatibility and comfortability. Additionally, by combining with the deep‐learning technique, an all‐textile sensing system is established to recognize object shape, contactless trajectory and environmental temperature.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
Telextiles: End-to-end Remote Transmission of Fabric Tactile Sensation

Takekazu Kitagishi,Yuichi Hiroi,Yuna Watanabe,Yuta Itoh,Jun Rekimoto

DOI: https://doi.org/10.1145/3586183.3606764

2024-05-06

Abstract:The tactile sensation of textiles is critical in determining the comfort of clothing. For remote use, such as online shopping, users cannot physically touch the textile of clothes, making it difficult to evaluate its tactile sensation. Tactile sensing and actuation devices are required to transmit the tactile sensation of textiles. The sensing device needs to recognize different garments, even with hand-held sensors. In addition, the existing actuation device can only present a limited number of known patterns and cannot transmit unknown tactile sensations of textiles. To address these issues, we propose Telextiles, an interface that can remotely transmit tactile sensations of textiles by creating a latent space that reflects the proximity of textiles through contrastive self-supervised learning. We confirm that textiles with similar tactile features are located close to each other in the latent space through a two-dimensional plot. We then compress the latent features for known textile samples into the 1D distance and apply the 16 textile samples to the rollers in the order of the distance. The roller is rotated to select the textile with the closest feature if an unknown textile is detected.

Human-Computer Interaction,Machine Learning
Intelligent textiles are looking bright

Yunzhu Li,Yiyue Luo

DOI: https://doi.org/10.1126/science.ado5922

IF: 56.9

2024-04-05

Science

Abstract:Flexible fiber electronics couple with the human body for wireless tactile sensing

multidisciplinary sciences
Fully Addressable Textile Sensor Array for Self-Powered Haptic Interfacing

Siwei Xiang,Guorui Chen,Qian Wen,Han Li,Xinxin Luo,Jiahua Zhong,Sophia Shen,Aiden Di Carlo,Xing Fan,Jun Chen

DOI: https://doi.org/10.1016/j.matt.2023.10.024

IF: 18.9

2024-01-01

Matter

Abstract:Wearable kinesthetic communication technology is a critical foundation for the rapidly evolving human-metaverse interface. Here, we introduce a fully embedded textile tactile sensor array that provides accurate and real-time haptic feedback. Benefiting from a reliable and scalable spacer -thread -based woven structure, it allows for tactile detection with a fine resolution of 0.1 mm and a rapid response time of 30 ms. Despite its advanced functionality, our haptic textile maintains superior wearing comfort and is designed to function without crosstalk or interference from environmental factors or motion artifacts. We demonstrate the potential of our haptic textile through the development of a machine -learning -assisted haptic textile glove, which enables individuals to experience virtual objects through the sense of touch. This glove uses tactile feedback to distinguish between materials based on roughness and can even recognize shapes as delicate as small insect footprints with an accuracy of 95.8%.
Customizing Textile and Tactile Skins for Interactive Industrial Robots

Bo Ying Su,Zhongqi Wei,James McCann,Wenzhen Yuan,Changliu Liu

2023-08-06

Abstract:Tactile skins made from textiles enhance robot-human interaction by localizing contact points and measuring contact forces. This paper presents a solution for rapidly fabricating, calibrating, and deploying these skins on industrial robot arms. The novel automated skin calibration procedure maps skin locations to robot geometry and calibrates contact force. Through experiments on a FANUC LR Mate 200id/7L industrial robot, we demonstrate that tactile skins made from textiles can be effectively used for human-robot interaction in industrial environments, and can provide unique opportunities in robot control and learning, making them a promising technology for enhancing robot perception and interaction.

Robotics
Industrially Scalable Textile Sensing Interfaces for Extended Artificial Tactile and Human Motion Monitoring without Compromising Comfort

Fameng Wang,Haoyun Li,Pengpeng Hu,Yudong Wang,Fuwang Guan,Xuzhong Su,Mohammad Irfan Iqbal,Fengxin Sun

DOI: https://doi.org/10.1021/acsami.4c00423

IF: 9.5

2024-03-24

ACS Applied Materials & Interfaces

Abstract:Smart wearables with the capability for continuous monitoring, perceiving, and understanding human tactile and motion signals, while ensuring comfort, are highly sought after for intelligent healthcare and smart life systems. However, concurrently achieving high-performance tactile sensing, long-lasting wearing comfort, and industrialized fabrication by a low-cost strategy remains a great challenge. This is primarily due to critical research gaps in novel textile structure design for seamless...

materials science, multidisciplinary,nanoscience & nanotechnology
Multimodal electronic textiles for intelligent human-machine interfaces

Xiao Wei,Xiaotong Liang,Chongguang Meng,Shuze Cao,Qiongfeng Shi,Jun Wu

DOI: https://doi.org/10.20517/ss.2023.09

2023-05-23

Soft Science

Abstract:Smart wearable electronic devices capable of information exchanging (such as human-machine interfaces) have developed into key carriers for the interconnection, intercommunication, and interaction between humans and machines. Multimodal electronic textiles that incorporate multifunctional sensors into daily clothing are an emerging technology to realize smart wearable electronics. This has greatly advanced human-machine interface technology by bridging the gap between wearing comfort and traditional wearable electronic devices, which will facilitate the rapid development and wide application of natural human-machine interfaces. In this article, we provide a comprehensive summary of the latest research progress on multimodal electronic textiles for intelligent human-machine interfaces. Firstly, we introduce the most representative electronic textile manufacturing strategies in terms of functional fiber preparation and multimodal textile forming. Then, we explore the multifunctional sensing capability of multimodal electronic textiles and emphasize their advanced applications in intelligent human-machine interfaces. Finally, we present new insights on the future research directions and the challenges faced in practical applications of multimodal electronic textiles.
All‐Organic Smart Textile Sensor for Deep‐Learning‐Assisted Multimodal Sensing

Pengfei Zhao,Yilin Song,Peng Xie,Fan Zhang,Tao Xie,Gang Liu,Jiyu Zhao,Su‐Ting Han,Ye Zhou

DOI: https://doi.org/10.1002/adfm.202301816

IF: 19

2023-04-18

Advanced Functional Materials

Abstract:An all‐organic textile sensor capable of discriminately sensing pressure, proximity, and temperature stimuli is developed. Outstanding washability and breathability are demonstrated. By combining with the deep‐learning technique, an all‐textile sensing system is established to recognize object shape, contactless trajectory, and even environmental temperature, showing a promising identification ability for complex information. Smart textile for sensor is identified as a superior platform with greatly improved convenience and comfort for wearable bioelectronics. However, most reported textile‐based sensors cannot fully demonstrate the inherent advantages of textiles, such as comfortability, breathability, biocompatibility, and environmental friendliness, mainly due to the intrinsic limitation of non‐textile or inorganic components. Here, an all‐textile, all‐organic, washable, and breathable sensor with discriminable pressure, proximity, and temperature sensing function is first reported. Multiple sensing functions and outstanding washability are demonstrated. The all‐textile sensor can also be seamlessly integrated into diverse types of fabrics to realize wide‐range sensing of human activities and noncontact stimuli without sacrificing biocompatibility and comfortability. Additionally, by combining with the deep‐learning technique, an all‐textile sensing system is established to recognize object shape, contactless trajectory, and even environmental temperature. These results open a new avenue for designing low‐cost, washable, comfortable, and biocompatible green textile electronics, providing a meaningful guideline in intelligent textiles.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
Smart Garment: A Long-Term Feasible, Whole-Body Textile Pressure-Sensing System

Zhen Liang,Dongquan Zhang,Guanghua Xu,Fangting Xie,Hui Cai,Hao Guo,Jingyuan Cheng

DOI: https://doi.org/10.1109/jsen.2023.3302857

IF: 4.3

2023-01-01

IEEE Sensors Journal

Abstract:Tactile sensation is important for human beings that equips the whole-body surface. To understand what kind of force distribution our bodies might sense, we created a set of pressure-sensing garment consisting of a sweater and trousers, which provides 1952 sensing points and covers 80% of the body surface evenly. As our skin works days and nights, an ideal pressure acquisition system for such purpose shall also feature both high temporal coverage and population coverage, casting simultaneous demands on wearability, durability, and affordability. Special cares were, thus, given to all design procedures, from material selection, sensor structure, and electronic-driving architecture to garment design. The capability of this smart garment in obtaining rich information about both the wearer and the environment is then demonstrated, including and not limited to the recognition of postures, self-contacts, object contacts, and interactions.
High-performance multimodal smart textile for artificial sensation and health monitoring

Xujing Zhang,Songsong Tang,Rui Ma,Zetong Chen,Jingting Zhuo,Lingyun Cao,Jin Yang,Guowei Yang,Fang Yi

DOI: https://doi.org/10.1016/j.nanoen.2022.107778

IF: 17.6

2022-12-01

Nano Energy

Abstract:Textile sensors are a branch of revolutionary electronics that carry tantalizing prospects toward myriad applications. However, their capability of differentiating multiple stimuli still remains a challenge. Here, we develop a multimodal smart textile that can simultaneously measure temperature and pulse/touch in real time, with high performance and no signal interference. The smart textile outputs two independent variables, with the whole textile as a triboelectric nanogenerator (TENG) to detect touch/pulse and its core thermoresistive micro/nano porous fiber strand (also is the TENG’s working electrode) to detect temperature. The stretchable core thermoresistive micro/nano porous fiber of the smart textile achieves record-high thermal sensitivity (β = 4994.55 K, α=−5.58%/K at 26 °C) and the fastest response/recovery time (97/239 ms) among previously reported fiber/textile-based temperature sensors, to our best knowledge. This fiber based on the growth of Fe2(MoO4)3 on graphene has much higher temperature sensing performance (∼3.2 times higher thermal sensitivity) than that based on directly blending Fe2(MoO4)3 and graphene. Moreover, the fiber has high thermal stability and its temperature sensing performance is insensitive to strain (stretching, bending and pressing). The smart textile is demonstrated for artificial sensation and health monitoring to simultaneously provide accurate profiles of both temperature and touch/pulse. This work provides new insights for wearable sensors.

materials science, multidisciplinary,chemistry, physical,physics, applied,nanoscience & nanotechnology
Tactile Rendering of Fabric Textures Based on Texture Recognition

Yixin Chen,Wenying Qiu,Xiaohao Wang,Min Zhang

DOI: https://doi.org/10.1109/NSENS49395.2019.9293989

2019-01-01

Abstract:A tactile rendering system for fabric textures is presented to improve the tactile sensations in humancomputer interactions in this paper. A tactile platform based on electrovibration is constructed to produce the virtual tactile sensation. The voltage amplitude perception threshold and differential threshold of human beings on the system are measured by a series of experiments. On this basis, the relationship between the stimulus signal and tactile perception is established using psychophysical experiments. A texture library of fabrics is then created by using a surface morphology analyzer. The amplitude of the corresponding voltage for rendering textures can be calculated according to the established relationship between the stimulus signal and tactile perception. As a new fabric texture image is input to the system, convolutional neural network (CNN) is used to match the texture with the texture library and then the corresponding stimulus signal can be generated. The above system is finally evaluated and numerically quantified through experiments.
Skin-inspired textile-based tactile sensors enable multifunctional sensing of wearables and soft robots

Yaokun Pang,Xianchen Xu,Shoue Chen,Yuhui Fang,Xiaodong Shi,Yiming Deng,Zhong-Lin Wang,Changyong Cao

DOI: https://doi.org/10.1016/j.nanoen.2022.107137

IF: 17.6

2022-06-01

Nano Energy

Abstract:Multifunctional tactile sensors that can mimic the sensory capabilities of human skin to perceive various external static and dynamic stimuli are essential to interact with the environment and humans for wearable electronics and soft intelligent robotics. Here, inspired by human skin, we report a textile-based tactile sensor capable of multifunctional sensing for personalized healthcare monitoring and soft robotic control. The tactile sensor consists of a triboelectric nanogenerator sensing layer to mimic the function of fast adapting (FA) mechanoreceptors and a piezoresistive sensing layer to achieve the functionality of slow adapting (SA) mechanoreceptors. The tactile sensor has been demonstrated to be able to recognize voice and monitor physiological signals and human motions in a real-time manner. Combined with a machine learning framework, the tactile sensor is able to percept surface textures and material types with high accuracy. It is also demonstrated as an effective human-machine interface for the control of assistive robotics.

materials science, multidisciplinary,chemistry, physical,physics, applied,nanoscience & nanotechnology

Textiles for Learning Tactile Interactions

Learning human–environment interactions using conformal tactile textiles

Intelligent textiles: designing a gesture-controlled illuminated textile based on computer vision

Design of an Interactive Device Based on e-Textile Material

IntelliTex: Fabricating Low-cost and Washable Functional Textiles Using A Double-coating Process

Intelligent Textiles for Visual and Smart Interaction

LayTex: A Design Tool for Generating Customized Textile Sensor Layouts in Wearable Computing

Adaptive tactile interaction transfer via digitally embroidered smart gloves

TacTex: A Textile Interface with Seamlessly-Integrated Electrodes for High-Resolution Electrotactile Stimulation

All‐Organic Smart Textile Sensor for Deep‐Learning‐Assisted Multimodal Sensing (Adv. Funct. Mater. 30/2023)

Telextiles: End-to-end Remote Transmission of Fabric Tactile Sensation

Intelligent textiles are looking bright

Fully Addressable Textile Sensor Array for Self-Powered Haptic Interfacing

Customizing Textile and Tactile Skins for Interactive Industrial Robots

Industrially Scalable Textile Sensing Interfaces for Extended Artificial Tactile and Human Motion Monitoring without Compromising Comfort

Multimodal electronic textiles for intelligent human-machine interfaces

All‐Organic Smart Textile Sensor for Deep‐Learning‐Assisted Multimodal Sensing

Smart Garment: A Long-Term Feasible, Whole-Body Textile Pressure-Sensing System

High-performance multimodal smart textile for artificial sensation and health monitoring

Tactile Rendering of Fabric Textures Based on Texture Recognition

Skin-inspired textile-based tactile sensors enable multifunctional sensing of wearables and soft robots