When Vision Meets Touch: A Contemporary Review for Visuotactile Sensors from the Signal Processing Perspective

Shoujie Li,Zihan Wang,Changsheng Wu,Xiang Li,Shan Luo,Bin Fang,Fuchun Sun,Xiao-Ping Zhang,Wenbo Ding

DOI: https://doi.org/10.1109/JSTSP.2024.3416841

2024-06-18

Abstract:Tactile sensors, which provide information about the physical properties of objects, are an essential component of robotic systems. The visuotactile sensing technology with the merits of high resolution and low cost has facilitated the development of robotics from environment exploration to dexterous operation. Over the years, several reviews on visuotactile sensors for robots have been presented, but few of them discussed the significance of signal processing methods to visuotactile sensors. Apart from ingenious hardware design, the full potential of the sensory system toward designated tasks can only be released with the appropriate signal processing methods. Therefore, this paper provides a comprehensive review of visuotactile sensors from the perspective of signal processing methods and outlooks possible future research directions for visuotactile sensors.

Robotics

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper primarily focuses on the importance of signal processing methods in visuotactile sensors and their applications. Specifically:

1. **Design and Signal Processing of Visuotactile Sensors**:
- **Sensor Design**: Discusses the structural design of visuotactile sensors, including sensing skin, lighting systems, and vision systems, and provides a classification summary of mainstream visuotactile sensors.
- **Signal Processing Techniques**: Provides a detailed introduction to signal processing techniques used for tasks such as contact area segmentation, 3D reconstruction, force sensing, slip detection, mapping and localization, and sim-to-real transfer.

2. **Shortcomings of Existing Research**:
- Current research on visuotactile sensors is mostly focused on hardware design and manufacturing processes, with less emphasis on the importance of signal processing methods. This paper aims to fill this gap by highlighting the critical role of signal processing in fully leveraging sensor performance.

3. **Future Development Directions**:
- Discusses the application limitations of visuotactile sensors and potential future development directions, such as improving resolution, reducing costs, and enhancing stability.

Through the above content, this paper hopes to advance research in the field of visuotactile sensors in terms of signal processing, thereby improving the performance of robots in complex tasks.