Abstract:We present HapTable; a multimodal interactive tabletop that allows users to interact with digital images and objects through natural touch gestures, and receive visual and haptic feedback accordingly. In our system, hand pose is registered by an infrared camera and hand gestures are classified using a Support Vector Machine (SVM) classifier. To display a rich set of haptic effects for both static and dynamic gestures, we integrated electromechanical and electrostatic actuation techniques effectively on tabletop surface of HapTable, which is a surface capacitive touch screen. We attached four piezo patches to the edges of tabletop to display vibrotactile feedback for static gestures. For this purpose, the vibration response of the tabletop, in the form of frequency response functions (FRFs), was obtained by a laser Doppler vibrometer for 84 grid points on its surface. Using these FRFs, it is possible to display localized vibrotactile feedback on the surface for static gestures. For dynamic gestures, we utilize the electrostatic actuation technique to modulate the frictional forces between finger skin and tabletop surface by applying voltage to its conductive layer. Here, we present two examples of such applications, one for static and one for dynamic gestures, along with detailed user studies. In the first one, user detects the direction of a virtual flow, such as that of wind or water, by putting their hand on the tabletop surface and feeling a vibrotactile stimulus traveling underneath it. In the second example, user rotates a virtual knob on the tabletop surface to select an item from a menu while feeling the knob's detents and resistance to rotation in the form of frictional haptic feedback.

Novel Interaction Techniques by Combining Hand and Foot Gestures on Tabletop Environments

A Comparative Study of Map Exploration Interfaces for Multi-Touch Tabletops.

Multi-user collaborative exploration of map and decision-making on a multi-touch tabletop

COMTIS: Customizable Touchless Interaction System for Large Screen Visualization

Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch Actions

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

Designing a 3D modelling tool for novice users.

Exploitation Of Novel Multiplayer Gesture-Based Interaction And Virtual Puppetry For Digital Storytelling To Develop Children'S Narrative Skills

Shoes++: A Smart Detachable Sole for Social Foot-to-foot Interaction.

Hand-posture-augmented Multitouch Interactions for Exploratory Visualization

Design, Implementations and Applications of Bidirectional Tangible Interfaces in a Tabletop Computing Platform

Vision-Based Projected Tabletop Interface For Finger Interactions

3D Intuitive Gesture Interaction via Motion Sensing

Finger Gesture Interaction On Large Tabletop For Sharing Digital Documents Among Multiple Users

Multi-Touch Tabletop System Using Infrared Image Recognition for User Position Identification

Recognizing Unintentional Touch on Interactive Tabletop.

An interaction system using mixed hand gestures.

HapTable: An Interactive Tabletop Providing Online Haptic Feedback for Touch Gestures

Two-Handed Interaction Techniques in Desktop VRs

Hand Gesture Interaction for Next-Generation Public Games

Research On The Tangible Tabletop Interaction System Based On The Optical Sensors