Abstract:Vision-based human-computer interaction (HCI) is a natural and human-centered way to make interaction between human and computer. Recently, with the miniaturization of projectors and the development of embedded systems, there has been an explosion of interest in systems which combine projection technology with computer vision. Associating a projector with a camera offers a cheap means to transform any surface into an interactive display surface. However, it is very hard to segment hand and recognize hand gesture due to self-occlusion, non-rigid tissue, even when the occlusion due to projection content can be avoided. In this paper, a novel approach is proposed to recognize finger stroke under the dynamic illumination circumstances. The approach is based on one projector and two heterogeneous cameras. First, an NIR camera is used to get the finger-tip and hand model, then, the hand model is used to get the interest points of the hand in the visible camera, then we can get the disparity of interest points from the two heterogeneous images. The disparity change is related to the depth change that can be used to determine when stroke event happens. Experiment results from a prototype system show that the approach can run in real-time without using special markers or gloves.

Design and Development of a Gesture-Based Interaction System for Multi-Projector Tiled Display Wall

COMTIS: Customizable Touchless Interaction System for Large Screen Visualization

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

Building Virtual Entertainment Environment with Tiled Display Wall and Motion Tracking.

An interaction system using mixed hand gestures.

Interactive 3D Editing on Tiled Display Wall

A Hand Gesture Based Interactive Presentation System Utilizing Heterogeneous Cameras

Promoted Motion-Sensing Gestural Interaction by Adapting to Group Users' Spatial Movements

Networked Gesture Tracking System Based on Immersive Real-Time Interaction

P‐78: an Interactive 360° Floating 3D Display Based on Gesture Recognition

3D Intuitive Gesture Interaction via Motion Sensing

A Multi-User Interaction System Based on Kinect and Wii Remote

Multi-Projector Tiled Display Wall Calibration With A Camera

Design of Three-Dimensional Gesture Recognition and Motion Tracking Human-Computer Intelligent Interaction System based on PAJ7620

Research on Projection Interaction Based on Gesture Recognition

A DISTRIBUTED INTERACTIVE PROJECTION SYSTEM BASED ON MULTI-CHANNEL VIDEO CAPTURE

A Real-time Personalized Gesture Interaction System Using Wii Remote and Kinect for Tiled-Display Environment

A Novel PRO-CAM Based Interactive Display Surface

Real-time Floating 3D Display Interaction System Based on Gesture Recognition by Leap Motion

GIUC: A Gesture Interface for Ubiquitous Computing

Three-dimensional interaction and autostereoscopic display system using gesture recognition