WiReSens Toolkit: An Open-source Platform towards Accessible Wireless Tactile Sensing

Devin Murphy,Junyi Zhu,Paul Liang,Wojciech Matusik,Yiyue Luo
2024-11-30
Abstract:Tactile sensors present a powerful means of capturing, analyzing, and augmenting human-environment interactions. Accelerated by advancements in design and manufacturing, resistive matrix-based sensing has emerged as a promising method for developing scalable and robust tactile sensors. However, the development of portable, adaptive, and long lasting resistive tactile sensing systems remains a challenge. To address this, we introduce WiReSens Toolkit. Our platform provides open-source hardware and software libraries to configure multi-sender, power-efficient, and adaptive wireless tactile sensing systems in as fast as ten minutes. We demonstrate our platform's flexibility by using it to prototype several applications such as musical gloves, gait monitoring shoe soles, and IoT-enabled smart home systems.
Human-Computer Interaction
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the challenges in developing a portable, self - adaptive and efficient resistive tactile sensing system. Specifically, the author points out that although advances in design and manufacturing have made tactile sensors based on resistive matrices a promising approach, there are still difficulties in achieving a movable, flexible and long - lasting resistive tactile sensing system. To address these issues, the author introduced the WiReSens Toolkit. ### Main problems 1. **Portability**: - Tactile sensing devices need to be separated from computationally intensive hardware to maintain mobility and be easily re - positioned. - The choice of wireless protocol depends on the environment (for example, using Wi - Fi indoors, but Wi - Fi may not be accessible outdoors), so the switching between different protocols needs to be simplified. 2. **Self - adaptability**: - The tactile sensing interface must adapt to different shapes, user requirements and application scenarios. - The system needs to support flexible read - out sizes and configurations to ensure minimal hardware and firmware updates. - The amplification requirements for pressure signals are different in different applications, and the amplification factor needs to be optimized to make full use of the ADC range and avoid output signal saturation. - Real - time visualization needs to be updated to adapt to different users or changes over time to ensure accurate monitoring and sensor adjustment during operation. 3. **Efficiency**: - Many human - machine interactions can only be captured through long - term monitoring, so the lifespan of tactile sensing devices is an important consideration. - Wireless communication is very power - consuming, which poses a challenge to sustainable development. - A trade - off between computing power and power consumption needs to be made while ensuring the effective use of resources. ### Solutions of the WiReSens Toolkit To meet the above challenges, the WiReSens Toolkit provides the following functions: - **Open - source hardware and software libraries**: Provide rapid configuration of multi - transmitter, low - power and self - adaptive wireless tactile sensing systems. - **Automatic sensitivity calibration**: Optimize the voltage output range of the sensor by adjusting the digital potentiometer (\( R_{\text{pot}} \)) to ensure the full - range use of the ADC and maximize the pressure resolution. - **Support for multiple wireless protocols**: Support three protocols, namely Wi - Fi, Bluetooth Low Energy (BLE) and ESP - NOW, and users can choose the most appropriate protocol according to the environment. - **Power - saving mode**: Save power by intermittent data transmission and prediction algorithms to reduce unnecessary data transmission. - **Interactive visualization tools**: Provide a customized real - time visualization interface, support multi - device monitoring and flexible layout adjustment. In conclusion, the WiReSens Toolkit aims to simplify and accelerate the development of portable, self - adaptive and efficient resistive tactile sensing systems by providing an open - source platform, thereby promoting their wide application and greater adoption in the research community.