Abstract:Elastomer‐based interfaces provide rich functionalities for tactile sensing, particularly in making tiny differences in contact dynamics potentially detectable. In this work, a new scheme of real‐time motion mode recognition is proposed for subtle deformations, which uses an optical tactile system to visualize and distinguish tiny variations in surface profile evolution encoded as images. Elastomer‐based interfaces provide rich functionalities for tactile sensing, particularly in making tiny differences in contact dynamics potentially detectable. However, the minimal motion‐induced changes in the elastomer's surface and their disappearance during time‐lapse limit the state recognition within the current scheme of motion recognition. In this work, a new scheme of real‐time motion mode recognition for subtle deformations is proposed, which uses an optical tactile sensing system to visualize and distinguish tiny variations in surface profile evolution encoded as images. Illustrating with a sphere, sliding‐induced asymmetric elastomer surface deformation is visualized as a "drag" in optical images. The convolutional neural network (CNN) algorithm is used to analyze the evolution of surface contour features during the interaction between the sphere and the elastic medium. Motion state recognition is achieved with 80% accuracy when a displacement of only 8.3% of the sphere diameter is produced. In addition, the system also offers the potential to analyze dynamic motion information through a single image, with an accuracy of 82.7% for velocity recognition. This dynamic real‐time recognition framework for soft media deformation paves the way for novel motion‐based input commands for tactile sensing and human‐computer interaction applications.

WSTac: Interactive Surface Perception based on Whisker-Inspired and Self-Illuminated Vision-Based Tactile Sensor

A Triboelectric-Based Artificial Whisker for Reactive Obstacle Avoidance and Local Mapping

Recognition of surface texture with wearable tactile sensor array: A pilot Study

TacWhiskers: Biomimetic optical tactile whiskered robots

A Novel Vision-Based Tactile Sensor Using Lamination and Gilding Process for Improvement of Outdoor Detection and Maintainability

SATac: A Thermoluminescence Enabled Tactile Sensor for Concurrent Perception of Temperature, Pressure, and Shear

A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network.

TIRgel: A Visuo-Tactile Sensor With Total Internal Reflection Mechanism for External Observation and Contact Detection

Self-powered visualized tactile-acoustic sensor for accurate artificial perception with high brightness and record-low detection limit

Seeing Through your Skin: Recognizing Objects with a Novel Visuotactile Sensor

A Miniaturised Camera-based Multi-Modal Tactile Sensor

Visually Aided Tactile Enhancement System Based on Ultrathin Highly Sensitive Crack-Based Strain Sensors

ViTacTip: Design and Verification of a Novel Biomimetic Physical Vision-Tactile Fusion Sensor

Acoustic Soft Tactile Skin (AST Skin)

Semi-flexible Bionic Whisker Sensor Based on Triboelectric Nanogenerators

Wearable Mechanotransduced Tactile Sensor for Haptic Perception

StereoTac: a Novel Visuotactile Sensor that Combines Tactile Sensing with 3D Vision

Design, Optimization and Application of Tactile Sensor Based on Virtual Binocular Vision

A Real‐Time Imaging Sensing System to Visualize Elastomer Surface Profile Evolution for Dynamic Tactile Recognition

A Biomimetic E-Whisker Sensor with Multimodal Perception and Stimuli Discrimination