Abstract:Tactile sensing is critical in advanced interactive systems by emulating the human sense of touch to detect stimuli. Vision-based tactile sensors (VBTSs) are promising for their ability to provide rich information, robustness, adaptability, low cost, and multimodal capabilities. However, current technologies still have limitations in sensitivity, spatial resolution, and the high computational demands of deep learning-based image processing. This paper presents a comprehensive approach combining a novel sensor structure with micromachined structures and an efficient image processing method, and demonstrates that carefully engineered microstructures within the sensor hardware can significantly enhance sensitivity while reducing computational load. Unlike traditional designs with tracking markers, our sensor incorporates an interface surface with micromachined trenches, as an example of microstructures, which modulate light transmission and amplify the variation in response to applied force. By capturing variations in brightness, wire width, and cross pattern locations with a camera, the sensor accurately infers the contact location, the magnitude of displacement and applied force with a lightweight convolutional neural network (CNN). Theoretical and experimental results demonstrated that the microstructures significantly enhance sensitivity by amplifying the visual effects of shape distortion. The sensor system effectively detected forces below 10 mN, and achieved a millimetre-level single-point spatial resolution. Using a model with only one convolutional layer, a mean absolute error (MAE) below 0.05 mm have been achieved. Its soft sensor body ensures compatibility with soft robots and wearable electronics, while its immunity to electrical crosstalk and interference guarantees reliability in complex human-machine environments.

DotView: A Low-Cost Compact Tactile Sensor for Pressure, Shear, and Torsion Estimation

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Multidimensional Tactile Sensor with a Thin Compound Eye-Inspired Imaging System

Development of Flexible Tactile Sensor for the Envelop of Curved Robotic Hand Finger in Grasping Force Sensing

Robot Tactile Sensing: Vision Based Tactile Sensor for Force Perception

DotTip: Enhancing Dexterous Robotic Manipulation with a Tactile Fingertip Featuring Curved Perceptual Morphology

Development of Fully Flexible Tactile Pressure Sensor with Bilayer Interlaced Bumps for Robotic Grasping Applications.

9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network.

Full Soft Capacitive Omnidirectional Tactile Sensor Based on Micro-Spines Electrode and Hemispheric Dielectric Structure

Minsight: A Fingertip-Sized Vision-Based Tactile Sensor for Robotic Manipulation

A NOVEL VISION-BASED TACTILE SENSOR USING PARTICLE IMAGE VELOCIMETRY FOR MULTI-MODAL OBJECT DETECTION AND FORCE SENSING

A soft thumb-sized vision-based sensor with accurate all-round force perception

DelTact: A Vision-based Tactile Sensor Using Dense Color Pattern

DTact: A Vision-Based Tactile Sensor That Measures High-Resolution 3D Geometry Directly from Darkness

High-Sensitivity Vision-Based Tactile Sensing Enhanced by Microstructures and Lightweight CNN

A Miniaturised Camera-based Multi-Modal Tactile Sensor

DenseTact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction

Large-Area and Low-Cost Force/Tactile Capacitive Sensor for Soft Robotic Applications

A Low-cost Super-Resolution Tactile Sensor: Design, Fabrication and Validation