Abstract:Teletaction, the transmission of tactile feedback or touch, is a crucial aspect in the field of teleoperation. High-quality teletaction feedback allows users to remotely manipulate objects and increase the quality of the human-machine interface between the operator and the robot, making complex manipulation tasks possible. Advances in the field of teletaction for teleoperation however, have yet to make full use of the high-resolution 3D data provided by modern vision-based tactile sensors. Existing solutions for teletaction lack in one or more areas of form or function, such as fidelity or hardware footprint. In this paper, we showcase our design for a low-cost teletaction device that can utilize real-time high-resolution tactile information from vision-based tactile sensors, through both physical 3D surface reconstruction and shear displacement. We present our device, the Feelit, which uses a combination of a pin-based shape display and compliant mechanisms to accomplish this task. The pin-based shape display utilizes an array of 24 servomotors with miniature Bowden cables, giving the device a resolution of 6x4 pins in a 15x10 mm display footprint. Each pin can actuate up to 3 mm in 200 ms, while providing 80 N of force and 1.5 um of depth resolution. Shear displacement and rotation is achieved using a compliant mechanism design, allowing a minimum of 1 mm displacement laterally and 10 degrees of rotation. This real-time 3D tactile reconstruction is achieved with the use of a vision-based tactile sensor, the GelSight [1], along with an algorithm that samples the depth data and marker tracking to generate actuator commands. Through a series of experiments including shape recognition and relative weight identification, we show that our device has the potential to expand teletaction capabilities in the teleoperation space.

A Novel Shape-Changing Haptic Table-Top Display

COMTIS: Customizable Touchless Interaction System for Large Screen Visualization

Mobile Terminals Haptic Interface: A Vibro-Tactile Finger Device for 3D Shape Rendering.

Perceptually Inspired C0-Continuity Haptic Shape Display with Trichamber Soft Actuators

Suspended Three-Dimensional Display Haptic Interaction Based on Leap Motion

33‐1: Invited Paper: Tabletop True 3D Display Systems Based on Projection Light Field and Integral Imaging

A Novel Interactive Device for 3D Display

HapTable: An Interactive Tabletop Providing Online Haptic Feedback for Touch Gestures

Tri-Modal Tactile Display and Its Application into Tactile Perception of Visualized Surfaces.

Dynamically reconfigurable shape-morphing and tactile display via hydraulically coupled mergeable and splittable PVC gel actuator

A Penetrable Interactive 3D Display Based on Motion Recognition （invited Paper）

Shape-Haptics: Planar & Passive Force Feedback Mechanisms for Physical Interfaces

Development Of A Haptic Display Interface

Vibrotactile Representation of Three-Dimensional Shape and Implementation on A Vibrotactile Pad

Feelit: Combining Compliant Shape Displays with Vision-Based Tactile Sensors for Real-Time Teletaction

Interactive Holographic Three-Dimensional Display with a Spatial Mouse

A novel true three-dimension display multi-touch system

A New Design of Texture Haptic Display System

Hand Manipulated Cubic Display for Virtual Environments

True three-dimension display based interaction technology

A Novel PRO-CAM Based Interactive Display Surface