Abstract:In this paper, with the goal of quantifying the qualitative image outputs of a Vision-based Tactile Sensor (VTS), we present the design, fabrication, and characterization of a novel Quantitative Surface Tactile Sensor (called QS-TS). QS-TS directly estimates the sensor's gel layer deformation in real-time enabling safe and autonomous tactile manipulation and servoing of delicate objects using robotic manipulators. The core of the proposed sensor is the utilization of miniature 1.5 mm x 1.5 mm synthetic square markers with inner binary patterns and a broad black border, called ArUco Markers. Each ArUco marker can provide real-time camera pose estimation that, in our design, is used as a quantitative measure for obtaining deformation of the QS-TS gel layer. Moreover, thanks to the use of ArUco markers, we propose a unique fabrication procedure that mitigates various challenges associated with the fabrication of the existing marker-based VTSs and offers an intuitive and less-arduous method for the construction of the VTS. Remarkably, the proposed fabrication facilitates the integration and adherence of markers with the gel layer to robustly and reliably obtain a quantitative measure of deformation in real-time regardless of the orientation of ArUco Markers. The performance and efficacy of the proposed QS-TS in estimating the deformation of the sensor's gel layer were experimentally evaluated and verified. Results demonstrate the phenomenal performance of the QS-TS in estimating the deformation of the gel layer with a relative error of <5%.

Real-time Marker Recognition Using Vision-based Tactile Sensor

Fine Texture Detection Based on a Solid-Liquid Composite Flexible Tactile Sensor Array

A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network.

Design and Verification of Tactile Sensor for Texture Recognition

A Dual-Modal Vision-Based Tactile Sensor for Robotic Hand Grasping.

Continuous Marker Patterns for Representing Contact Information in Vision-Based Tactile Sensor: Principle, Algorithm, and Verification

3D Dense Reconstruction of Vision-based Tactile Sensor with Coded Markers

Real-Time Marker Localization Learning for GelStereo Tactile Sensing

Signal Processing Circuit for Vision-Based Tactile Sensor

A Miniaturised Camera-based Multi-Modal Tactile Sensor

A Cross-Modal Tactile Sensor Design for Measuring Robotic Grasping Forces

Vision-based Tactile Sensor Using Depth from Defocus for Artificial Finger in Hand Prosthesis

Towards Design and Development of an ArUco Markers-Based Quantitative Surface Tactile Sensor

A Novel Vision-Based Tactile Sensor Using Lamination and Gilding Process for Improvement of Outdoor Detection and Maintainability

Real-Time Reconstruction of 3D Tactile Motion Field Via Multi-Task Learning

Improving the Representation and Extraction of Contact Information in Vision-based Tactile Sensors Using Continuous Marker Pattern

Fingerprint-inspired Biomimetic Tactile Sensors for the Surface Texture Recognition

Evetac: An Event-Based Optical Tactile Sensor for Robotic Manipulation

Real-time and Robust Feature Detection of Continuous Marker Pattern for Dense 3-D Deformation Measurement

DTact: A Vision-Based Tactile Sensor That Measures High-Resolution 3D Geometry Directly from Darkness

DelTact: A Vision-based Tactile Sensor Using Dense Color Pattern