Abstract:Marker-type vision-based tactile sensors (VTS) realize force sensing by calibrating marker vector information. The tactile visualization can provide high-precision and multimodal force information to promote robotic dexterous manipulation development. Considering VTS's contribution to force measurement, this article reviews the advanced force measurement technologies of VTSs. First, the working principle of marker-type VTSs is introduced, including single-layer markers, double-layer markers, color coding, and optical flow. Then, the relationship between the marker type and the category of force measurement is discussed in detail. On this basis, the process of marker feature extraction is summarized, including image processing and marker-matching technologies. According to the learning approach, force measurement methods are classified into physical and deep learning models. Further, branches of each method are analyzed in terms of input types. Combined with measuring range and precision, the correlation of sensor design, materials, and recognition methods to force measurement performance is further discussed. Finally, the difficulties and challenges are analyzed, and future developments are proposed. This review aims to deepen understanding of the research progress and applications and provide a reference for the research community to promote technology generations in related fields. Force sensing is an important function of marker-type vision-based tactile sensors. This review focuses on force measurement technologies based on visuotactile sensing from sensing principle, marker layer design, information process, and measurement precision, intending to provide a reference for the research community in marker layer design optimization, high-quality force feature extraction, and robot's operating tasks.image (c) 2024 WILEY-VCH GmbH

Continuous Marker Patterns for Representing Contact Information in Vision-Based Tactile Sensor: Principle, Algorithm, and Verification

Improving the Representation and Extraction of Contact Information in Vision-based Tactile Sensors Using Continuous Marker Pattern

Real-time and Robust Feature Detection of Continuous Marker Pattern for Dense 3-D Deformation Measurement

Marker Displacement Method Used in Vision-Based Tactile Sensors—From 2-D to 3-D: A Review

Vision-based Tactile Image Generation via Contact Condition-guided Diffusion Model

Real-time Marker Recognition Using Vision-based Tactile Sensor

DelTact: A Vision-based Tactile Sensor Using Dense Color Pattern

A Dual-Modal Vision-Based Tactile Sensor for Robotic Hand Grasping.

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

A Cross-Modal Tactile Sensor Design for Measuring Robotic Grasping Forces

Development of Robotic Hand Tactile Sensing System for Distributed Contact Force Sensing in Robotic Dexterous Multimodal Grasping

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

Design, Optimization and Application of Tactile Sensor Based on Virtual Binocular Vision

DTact: A Vision-Based Tactile Sensor That Measures High-Resolution 3D Geometry Directly from Darkness

Force Measurement Technology of Vision-Based Tactile Sensor

Model-Based 3D Contact Geometry Perception for Visual Tactile Sensor

DTact: A Vision-Based Tactile Sensor that Measures High-Resolution 3D Geometry Directly from Darkness

Implementing Monocular Visual-Tactile Sensors for Robust Manipulation

Design and Evaluation of a Rapid Monolithic Manufacturing Technique for a Novel Vision-Based Tactile Sensor: C-Sight