Abstract:We present the architecture and algorithm design of a visual motion based perceptual interface for mobile devices with cameras. In addition to motion vector, we use the term "visual motion" to be any dynamic changes on consecutive image frames. In the lower architectural hierarchy, visual motion events are defined by identifying distinctive motion patterns. In the higher hierarchy, these visual events are used for interacting with user applications. We present an approach to context aware motion vector estimation to better tradeoff between speed and accuracy. It switches among a set of motion estimation algorithms of different speeds and precisions based on system context such as computation load and battery level. For example, when the CPU is heavily loaded or the battery level is low, we switch to a fast but less accurate algorithm, and vice versa. Moreover, to obtain more accurate motion vectors, we propose to adapt the search center of fast block matching methods based on previous motion vectors. Both quantitative evaluation of algorithms and subjective usability study are conducted. It is demonstrated that the proposed approach is very robust yet efficient.

A Perceptual User Interface For Motion Retrieval

Performance-Driven Motion Retrieval and its Usability Evaluation

Motion-Based Perceptual User Interface

Review on Perceptual User Interfaces Based on Motion Sensors

An efficient algorithm for content-based human motion retrieval

3D Intuitive Gesture Interaction via Motion Sensing

Motion retrieval based on movement notation language: Motion Capture and Retrieval

Human motion retrieval based on freehand sketch

Content-Based human motion retrieval with automatic transition

Motion Retrieval Based On Movement Notation Language

A Motion-based User Interface for the Control of Virtual Humans Performing Sports.

Morphology Independent Motion Retrieval and Control

Peye: Toward A Visual Motion Based Perceptual Interface For Mobile Devices

Content-Based Human Motion Retrieval with Scene Description Language

Responsive Action Generation By Physically-Based Motion Retrieval And Adaptation

Video retrieval using VQ-based global motion features

A Semantic Feature for Human Motion Retrieval

A MOTION BASED VIDEO RETRIEVAL SYSTEM

Perceiving Motion Cues Inspired by Microsoft Kinect Sensor on Game Experiencing

Sketch-based Human Motion Retrieval Via Selected 2D Geometric Posture Descriptor

Promoted Motion-Sensing Gestural Interaction by Adapting to Group Users' Spatial Movements