Jieji Ren,Heng Guo,Zaiyan Yang,Jinnuo Zhang,Yueshi Dong,Ningbin Zhang,Boxin Shi,Jiang Zou,Guoying Gu
Abstract:Camera-based tactile sensors can provide high-density surface geometry and force information for robots in the interaction process with the target. However, most existing methods cannot achieve accurate reconstruction with high efficiency, impeding the applications in robots. To address these problems, we propose an efficient two-shot photometric stereo method based on symmetric color LED distribution. Specifically, based on the sensing response curve of CMOS channels, we design orthogonal red and blue LEDs as illumination to acquire four observation maps using channel-splitting in a two-shot manner. Subsequently, we develop a two-shot photometric stereo theory, which can estimate accurate surface normal and greatly reduce the computing overhead in magnitude. Finally, leveraging the characteristics of the camera-based tactile sensor, we optimize the algorithm to be a highly efficient, pure addition operation. Simulation and real-world experiments demonstrate the advantages of our approach. Further details are available on: <a class="link-external link-https" href="https://github.com/Tacxels/SymmeTac" rel="external noopener nofollow">this https URL</a>.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: **How to achieve efficient and accurate surface geometry reconstruction based on camera - based tactile sensors**.
Specifically, existing camera - based tactile sensors can provide high - density surface geometry and force information for robots during the interaction with target objects. However, most of the existing methods cannot achieve both efficient and accurate reconstruction simultaneously, which limits their wide use in robotic applications. The main challenges include:
1. **Low efficiency**: Traditional Photometric Stereo (PS) methods require sequential observations under multiple different lighting conditions, resulting in a long - lasting reconstruction process.
2. **Insufficient accuracy**: Some methods rely on Look - up Tables, but these methods are vulnerable to imaging errors or edge - detection errors, and as the table size increases, the reconstruction accuracy decreases instead.
3. **Poor universality**: Many methods have a high dependence on specific sensors or environments and lack universality.
To solve these problems, the authors propose an efficient two - step Photometric Stereo reconstruction method named **SymmeTac**. This method utilizes a symmetrically - distributed color LED lighting design, and can obtain four independent observation maps through two shootings. On this basis, an efficient Photometric Stereo theoretical model is developed, which can significantly reduce the computational cost and improve the reconstruction accuracy.
### Main contributions
1. **Propose an efficient two - step Photometric Stereo method**, which can greatly reduce the amount of computation while ensuring the reconstruction accuracy.
2. **Fully utilize the spectral characteristics of the camera and the position prior of the LED**, and achieve efficient multi - angle observations through red - blue channel separation.
3. **Verify the effectiveness of this method through simulation and real - world experiments**, and show its potential in robotic tactile perception.
### Method overview
- **Symmetric lighting design**: Utilize symmetrically - distributed red and blue LEDs to illuminate in two directions respectively, and two independent red - blue channel images can be obtained for each shooting.
- **Two - step Photometric Stereo model**: Through the four images obtained from two shootings, combined with the Photometric Stereo theory, derive the analytical expression of the surface normal vector, thereby achieving efficient reconstruction.
- **Simplify the calculation**: Based on the camera response curve and LED characteristics, simplify the complex calculation into a simple addition operation, further improving the computational efficiency.
Through these innovations, the SymmeTac method not only improves the accuracy and efficiency of reconstruction, but also provides a new solution for camera - based tactile sensors in robotic applications.