Abstract:In conjunction with huge recent progress in camera and computer vision technology, camera-based sensors have increasingly shown considerable promise in relation to tactile sensing. In comparison to competing technologies (be they resistive, capacitive or magnetic based), they offer super-high-resolution, while suffering from fewer wiring problems. The human tactile system is composed of various types of mechanoreceptors, each able to perceive and process distinct information such as force, pressure, texture, etc. Camera-based tactile sensors such as GelSight mainly focus on high-resolution geometric sensing on a flat surface, and their force measurement capabilities are limited by the hysteresis and non-linearity of the silicone material. In this paper, we present a miniaturised dome-shaped camera-based tactile sensor that allows accurate force and tactile sensing in a single coherent system. The key novelty of the sensor design is as follows. First, we demonstrate how to build a smooth silicone hemispheric sensing medium with uniform markers on its curved surface. Second, we enhance the illumination of the rounded silicone with diffused LEDs. Third, we construct a force-sensitive mechanical structure in a compact form factor with usage of springs to accurately perceive forces. Our multi-modal sensor is able to acquire tactile information from multi-axis forces, local force distribution, and contact geometry, all in real-time. We apply an end-to-end deep learning method to process all the information.

Prototype of A Novel Visuotactile Endoscope Probe

Visual Tactile Sensor Based on Infrared Controllable Variable Stiffness Structure

A Miniature Endoscopic Optical Coherence Tomography Probe Based on C-Lens

A Miniaturised Camera-based Multi-Modal Tactile Sensor

In Vivo Endoscopic Optical Coherence Elastography Based on a Miniature Probe

StereoTac: a Novel Visuotactile Sensor that Combines Tactile Sensing with 3D Vision

Design of an endoscopic OCT probe based on piezoelectric tube with quartered outside electrodes

A Novel Small Form-Factor Handheld Optical Coherence Tomography Probe for Oral Soft Tissue Imaging

An Origami-Inspired Endoscopic Capsule with Tactile Perception for Early Tissue Anomaly Detection

Deformation Pattern Shape Sensing for Visuotactile Endoscope

Tactile Perception: a Biomimetic Whisker-Based Method for Clinical Gastrointestinal Diseases Screening

Progress in Probe-Based Sensing Techniques for In Vivo Diagnosis

Development of A Combined Ultrasound and Photoacoustic Endoscopic Probe

Design and Development of a Novel Soft and Inflatable Tactile Sensing Balloon for Early Diagnosis of Colorectal Cancer Polyps

TIRgel: A Visuo-Tactile Sensor With Total Internal Reflection Mechanism for External Observation and Contact Detection

Transparent Pneumatic Tactile Sensors for Soft Biomedical Robotics

Design, Optimization and Application of Tactile Sensor Based on Virtual Binocular Vision

A novel probe for endoscopic OCT imaging

CompdVision: Combining Near-Field 3D Visual and Tactile Sensing Using a Compact Compound-Eye Imaging System