Abstract:Summary form only given. In the PC+ era, a variety of new mobile devices, such as Web-enabled watch, Smartphone, Pocket PC, Tablet PC, etc, are making a population boom. As most of current documents and multimedia contents are designed for applications on desktop PC, we are facing a big challenge - the problem of multiple form factors resulted from the diverse set of emerging new devices. For example, browsing conventional Web pages on Pocket PC is a pain. Browsing a large picture on Smartphone (e.g. picture messaging application) is no different to a thumbnail view, even though the users are now able to capture high-resolution pictures on the latest models of camera-equipped cell phones. Furthermore, enterprise software applications have been aiming to take the advantage of ubiquitous network connection by mobile Internet to increase the productivity of information workers. As the current document-related applications are highly desktop-PC focused, to unleash the power of mobile Internet in the PC+ era, we need to innovate more aggressively and develop a new generation of document and content technologies to cope with the problem of multiple form factors. In this paper, we briefly review the past research and development on adapting multimedia content for heterogeneous device capability, user context and network environment, including the MPEG-7 standard. Then, we focus on the challenge of limited display and input capability in mobile devices, we believe that in order to successfully tackle this challenge, we need to (a) develop new content representation which is scalable and adaptable, (b) develop content analysis techniques to structure content for the new representation, (c) develop corresponding rendering algorithms and innovative user interfaces to maximize the information throughput of the content on small devices, and (d) make content adaptation service part of mobile Internet architecture. We also introduce some specific research works that we have been conducting towards this direction in Microsoft Research Asia. These works include Scalable Web Document which is a new Web content representation for various display sizes, Smart Picture which uses image attention model to facilitate the browsing of large pictures on mobile devices, and Media Compan- ion which uses proxy augmentation on the edge of mobile Internet to construct a content service overlay for dynamic adaptation and value-added services.

Experience with adaptive mobile applications in Odyssey

AppMoD

Adroitness: An Android-based Middleware for Fast Development of High-performance Apps

Using Evaluators to Enable Intelligent Adaptation for Mobile Web Applications

Automated Application Offloading through Ant-inspired Decision-Making

A Platform for Developing Adaptable Multicore Applications

Adapting ubicomp software and its evaluation

AEGIS: A Proactive Methodology to Shield against Zero-Day Exploits

TalkingAndroid: an Interactive, Multimodal and Real-Time Talking Avatar Application on Mobile Phones

Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps

GUI Odyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devices

Teaching Advanced Web Technologies with a Mobile Learning Companion Application

Adaptive Content Delivery on Mobile Internet across Multiple Form Factor.

Usage Habit-oriented Self-adaptive Method for Android Applications

SM@RT Offloader: Supporting Adaptive Computation Offloading for Android Applications.

Democratizing mobile app development for disaster management

Long-life application

MobileAgent: enhancing mobile control via human-machine interaction and SOP integration

Mobile Robot Middleware Supporting Self-adaptive Programming

Interaction Techniques for Exploratory Data Visualization on Mobile Devices

Mobile Agent-based Adaptation Technology of Software Entity