Abstract:Input devices based on direct touch have replaced traditional ones and become the mainstream interactive technology for handheld devices. Although direct touch interaction proves to be easy to use, its problems, e.g. the occlusion problem and the fat finger problem, lower user experience. Camera-based mobile interaction is one of the solutions to overcome the problems. There are two typical interaction styles to generate camera-based pointing interaction for handheld devices: move the device or move an object before the camera. In the first interaction style, there are two approaches to move a cursor's position across the handheld display: move it towards the same direction or the opposite direction which the device moves to. In this paper, the results of a comparison research, which compared the pointing performances of three camera-based pointing techniques, are presented. All pointing techniques utilized input from the rear-facing camera. The results indicate that the interaction style of moving a finger before the camera outperforms the other one in efficiency, accuracy, and throughput. The results also indicate that within the interaction style of moving the device, the cursor positioning style of moving the cursor to the opposite direction is slightly better than the other one in efficiency and throughput. Based on the findings, we suggest giving priority to the interaction style of moving a finger when deploying camera-based pointing techniques on handheld devices. Given that the interaction style of moving the device supports one-handed manipulation, it also worth deploying when one-handed interaction is needed. According to the results, the cursor positioning style of moving the cursor towards the opposite direction which the device moves to may be a better choice.

Experimental Analysis of Mode Switching Techniques in Pen-Based User Interfaces

Mode Switching Techniques Through Pen and Device Profiles.

Augmenting User-Maintained Interaction Through Mode Locking and Reversing

A Comparative Study of Map Exploration Interfaces for Multi-Touch Tabletops.

Separating and Recognizing Gestural Strokes for Sketch-Based Interfaces

Differences in muscle activity, kinematics, user performance, and subjective assessment between touchscreen and mid-air interactions on a tablet

Design and Evaluation of Pen Body Commands

A Multitouch Drawing Application With Occlusion-Free Interaction Strategies

Controlling Non-Touch Screens as Touch Screens Using Airpen, a Writing Tool with In-Air Gesturing Mode

Exploring Head-based Mode-Switching in Virtual Reality

An Investigation on Selection Mechanisms for Mobile Camera-based Cursor Manipulation

Assessing Mode-Switching Strategies for Assistive Robotic Manipulators Using a Preliminary Version of the Novel Non-invasive Tongue-Computer Interface

Construction of Penalty Function and Multi-modal Smooth Transition Strategy

A Comparison Study on Camera-Based Pointing Techniques for Handheld Displays.

pPen: enabling authenticated pen and touch interaction on tabletop surfaces

An Ergonomic Study of the Efficiency of the Mobile Shortcuts and Page-Turning Keys in Chinese Users

Effect of Mechanical Keyboard Switch and Backlight Status on Typing Performance and User Experience

A Study on Usability of Finger's Moving Direction in Direct Touch Environment

MixPad: augmenting interactive paper with mice & keyboards for cross-media and fine-grained interaction with documents.

Functional parameters, wrist posture deviations and comfort: A comparison between a computer mouse and a touch pen as input devices.

Enhancing Pie-Menu Selection with Pen Pressure