A Fingertip Sensor and Algorithms for Pre-touch Distance Ranging and Material Detection in Robotic Grasping

Cheng Fang,Di Wang,Fengzhi Guo,Jun Zou,Dezhen Song

2023-11-17

Abstract:To enhance robotic grasping capabilities, we are developing new contactless fingertip sensors to measure distance in close proximity and simultaneously detect the type of material and the interior structure. These sensors are referred to as pre-touch dual-modal and dual-mechanism (PDM$^2$) sensors, and they operate using both pulse-echo ultrasound (US) and optoacoustic (OA) modalities. We present the design of a PDM$^2$ sensor that utilizes a pulsed laser beam and a customized ultrasound transceiver with a wide acoustic bandwidth for ranging and sensing. Both US and OA signals are collected simultaneously, triggered by the same laser pulse. To validate our design, we have fabricated a prototype of the PDM$^2$ sensor and integrated it into an object scanning system. We have also developed algorithms to enable the sensor, including time-of-flight (ToF) auto estimation, ranging rectification, sensor and system calibration, distance ranging, material/structure detection, and object contour detection and reconstruction. The experimental results demonstrate that the new PDM$^2$ sensor and its algorithms effectively enable the object scanning system to achieve satisfactory ranging and contour reconstruction performances, along with satisfying material/structure detection capabilities. In conclusion, the PDM$^2$ sensor offers a practical and powerful solution to improve grasping of unknown objects with the robotic gripper by providing advanced perception capabilities.

Robotics

What problem does this paper attempt to address?

This paper attempts to address the problem of how to enhance the perception capabilities of robots when grasping unknown objects, particularly in terms of pre-contact distance measurement and material detection. Specifically, the authors developed a novel fingertip sensor (PDM2 sensor) that combines two modalities: pulse-echo ultrasound (US) and photoacoustic (OA). This sensor can measure distance, detect material types, and internal structures without contacting the object. With this sensor, robots can obtain crucial information about the object before grasping, allowing them to formulate more optimized grasping strategies and improve the success rate of grasping tasks.

### Main Issues:
1. **Pre-contact Distance Measurement**: When robots grasp unknown objects, it is necessary to accurately measure the distance between the fingertip and the object to dynamically adjust the grasping strategy.
2. **Material and Internal Structure Detection**: Understanding the material type and internal structure of the object before grasping helps predict key parameters such as friction coefficient and contact force, thereby avoiding damage to the object or grasping failure.
3. **Limitations of Existing Sensors**: Existing sensor technologies (such as cameras, laser rangefinders, tactile sensors, etc.) have many limitations in close-range measurement and material detection, such as occlusion issues, blind spots, and the need for physical contact.

### Solution:
- **PDM2 Sensor Design**: Combines pulse-echo ultrasound (US) and photoacoustic (OA) modalities to achieve pre-contact distance measurement and material detection.
- **Signal Processing Algorithms**: Developed algorithms for automatic time-of-flight (ToF) estimation, distance correction, sensor, and system calibration to enhance sensor performance.
- **Experimental Validation**: Prototyped the PDM2 sensor and built an object scanning system to experimentally validate the sensor's effectiveness and accuracy.

### Experimental Results:
- **Distance Measurement Accuracy**: Maximum deviation is less than 0.2 millimeters, indicating high-precision distance measurement capability.
- **Material Detection Capability**: Successfully distinguished eight types of materials with optical and acoustic challenges, demonstrating strong material detection capability.

In summary, the PDM2 sensor provides advanced perception capabilities for robots to grasp unknown objects, improving the success rate of grasping tasks and expanding the application fields of robots.