Abstract:Teleoperation allows workers to safely control powerful construction machines; however, its primary reliance on visual feedback limits the operator's efficiency in situations with stiff contact or poor visibility, hindering its use for assembly of pre-fabricated building components. Reliable, economical, and easy-to-implement haptic feedback could fill this perception gap and facilitate the broader use of robots in construction and other application areas. Thus, we adapted widely available commercial audio equipment to create AiroTouch, a naturalistic haptic feedback system that measures the vibration experienced by each robot tool and enables the operator to feel a scaled version of this vibration in real time. Accurate haptic transmission was achieved by optimizing the positions of the system's off-the-shelf accelerometers and voice-coil actuators. A study was conducted to evaluate how adding this naturalistic type of vibrotactile feedback affects the operator during telerobotic assembly. Thirty participants used a bimanual dexterous teleoperation system (Intuitive da Vinci Si) to build a small rigid structure under three randomly ordered haptic feedback conditions: no vibrations, one-axis vibrations, and summed three-axis vibrations. The results show that users took advantage of both tested versions of the naturalistic haptic feedback after gaining some experience with the task, causing significantly lower vibrations and forces in the second trial. Subjective responses indicate that haptic feedback increased the realism of the interaction and reduced the perceived task duration, task difficulty, and fatigue. As hypothesized, higher haptic feedback gains were chosen by users with larger hands and for the smaller sensed vibrations in the one-axis condition. These results elucidate important details for effective implementation of naturalistic vibrotactile feedback and demonstrate that our accessible audio-based approach could enhance user performance and experience during telerobotic assembly in construction and other application domains.

Sound Reduction of Vibration Feedback by Perceptually Similar Modulation

Extracting Haptic Information from High-Frequency Vibratory Signals Measured on a Remote Robot to Transmit Collisions with Environments.

Reducing Sound of Tactile Display for High-Frequency Collision Vibrations

Tactile Feedback System of High-Frequency Vibration Signals for Supporting Delicate Teleoperation of Construction Robots.

Vibrotactile Feedback for a Remote Operated Robot with Noise Subtraction Based on Perceived Intensity

Using Auditory Noise to Enhance the Fine-Motor of Human's Hand Due to Cross-Modal Stochastic Resonance.

Noise-controlled Technique to Improve Vibration Touch in Humans

A Vibrotactile Feedback User Interface for Haptic Teleoperation of Aerial Robots

Experimental Study on Electrical Noise Reducing Vibration Sense

A Patterned Vibrotactile Method Using Envelope Modulation with High Resolution and Low Perceptual Frequency

Haptic Feedback of Tool Vibrations Facilitates Telerobotic Construction

Tonal Vibration Suppression with A Model-Free Control Method

The high/low frequency balance drives tactile perception of noisy vibrations

The high/low frequency balance drives the perception of noisy vibrations

Hearing how you touch: Real-time synthesis of contact sounds for multisensory interaction

AeroHaptix: A Wearable Vibrotactile Feedback System for Enhancing Collision Avoidance in UAV Teleoperation

AiroTouch: enhancing telerobotic assembly through naturalistic haptic feedback of tool vibrations

Virtual Feedback Control of Interior Road Noise Based on Headrest Loudspeakers

A Vibration Absorption Method for Alleviating Impact of the Flexible Robotic Arm

Optimized Design of A Haptic Unit for Vibrotactile Amplitude Modulation

Towards sensory substitution and augmentation: Mapping visual distance to audio and tactile frequency