Abstract:Emerging terminals, such as smartwatches, true wireless earphones, in-vehicle computers, etc., are complementing our portals to ubiquitous information services. However, the current ecology of information services, encapsulated into millions of mobile apps, is largely restricted to smartphones; accommodating them to new devices requires tremendous and almost unbearable engineering efforts. Interaction Proxy, firstly proposed as an accessible technique, is a potential solution to mitigate this problem. Rather than re-building an entire application, Interaction Proxy constructs an alternative user interface that intercepts and translates interaction events and states between users and the original app's interface. However, in such a system, one key challenge is how to robustly and efficiently "communicate" with the original interface given the instability and dynamicity of mobile apps (e.g., dynamic application status and unstable layout). To handle this, we first define UI-Independent Application Description (UIAD), a reverse-engineered semantic model of mobile services, and then propose Interaction Proxy Manager (IPManager), which is responsible for synchronizing and managing the original apps' interface, and providing a concise programming interface that exposes information and method entries of the concerned mobile services. In this way, developers can build alternative interfaces without dealing with the complexity of communicating with the original app's interfaces. In this paper, we elaborate the design and implementation of our IPManager, and demonstrate its effectiveness by developing three typical proxies, mobile-smartwatch, mobile-vehicle and mobile-voice. We conclude by discussing the value of our approach to promote ubiquitous computing, as well as its limitations.

U-Interactive: A Middleware For Ubiquitous Fashionable Computer To Interact With The Ubiquitous Environment By Gestures

UbiTap

An Agent-Based Multimodal User Interfaces Middleware for Ubiquitous Computing Environments: Intelligent Exhibition Hall

A Mobile Interactive System Generation Framework from Conceptual Model to Development Paradigm

mu-ware: A Middleware Framework for Wearable Computer and Ubiquitous Computing Environment

A catalog of inverse-kinematics planners for underactuated systems on matrix groups

PERCEPTUAL USER INTERFACE IN VIRTUAL SHOPPING ENVIRONMENT

A Real Time Wireless Interactive Multimedia System

A middleware for implicit interaction

Motion-Based Perceptual User Interface

Ubiquitous Augmented Reality System

U-Garden: an Interactive Control System for Multimodal Presentation in Museum.

Implementation of the Interactive Gestures of Virtual Avatar Based on a Multi-user Virtual Learning Environment

Game-City: A Ubiquitous Large Area Multi-Interface Mixed Reality Game Space for Wearable Computers

UbiTouch

A Context-Aware Middleware for Interaction Device Deployment in AmI.

Innovative Wearable Interfaces: an Exploratory Analysis of Paper-Based Interfaces with Camera-Glasses Device Unit

Interaction Proxy Manager: Semantic Model Generation and Run-time Support for Reconstructing Ubiquitous User Interfaces of Mobile Services.

Designing Transparent Interaction For Ubiquitous Computing: Theory And Application

ReflectU: A Mirror-based Intelligent Interactive System for Intuitive Remote Control

Motion Interactive System with Omni-Directional Display