Abstract:Summary form only given. In the PC+ era, a variety of new mobile devices, such as Web-enabled watch, Smartphone, Pocket PC, Tablet PC, etc, are making a population boom. As most of current documents and multimedia contents are designed for applications on desktop PC, we are facing a big challenge - the problem of multiple form factors resulted from the diverse set of emerging new devices. For example, browsing conventional Web pages on Pocket PC is a pain. Browsing a large picture on Smartphone (e.g. picture messaging application) is no different to a thumbnail view, even though the users are now able to capture high-resolution pictures on the latest models of camera-equipped cell phones. Furthermore, enterprise software applications have been aiming to take the advantage of ubiquitous network connection by mobile Internet to increase the productivity of information workers. As the current document-related applications are highly desktop-PC focused, to unleash the power of mobile Internet in the PC+ era, we need to innovate more aggressively and develop a new generation of document and content technologies to cope with the problem of multiple form factors. In this paper, we briefly review the past research and development on adapting multimedia content for heterogeneous device capability, user context and network environment, including the MPEG-7 standard. Then, we focus on the challenge of limited display and input capability in mobile devices, we believe that in order to successfully tackle this challenge, we need to (a) develop new content representation which is scalable and adaptable, (b) develop content analysis techniques to structure content for the new representation, (c) develop corresponding rendering algorithms and innovative user interfaces to maximize the information throughput of the content on small devices, and (d) make content adaptation service part of mobile Internet architecture. We also introduce some specific research works that we have been conducting towards this direction in Microsoft Research Asia. These works include Scalable Web Document which is a new Web content representation for various display sizes, Smart Picture which uses image attention model to facilitate the browsing of large pictures on mobile devices, and Media Compan- ion which uses proxy augmentation on the edge of mobile Internet to construct a content service overlay for dynamic adaptation and value-added services.

Closing the Gap: Human Factors in Cross-Device Media Synchronization.

Collaboration Upon Heterogeneous Platforms - From Desktop Pc To Handheld Device

Adaptive Content Delivery on Mobile Internet across Multiple Form Factor.

Mobile Media Communication, Processing, and Analysis: A Review of Recent Advances

Leveraging Mobile Media: Cross-Media Strategy and Innovation Policy for Mobile Media Communication

Synchronization-Oriented Placement and Retrieval Strategies for Delay-Sensitive Media Streams

Multidevice mobile sessions: A first look

Challenges in Mobile Multi-Device Ecosystems

Mobile Media: Coming of Age with A Big Splash

User Experience for Multi-Device Ecosystems: Challenges and Opportunities

Multi-Object Multimedia Presentation Synchronization Strategy

Cluster-Oriented Device-to-Device Multimedia Communications: Joint Power, Bandwidth, and Link Selection Optimization.

Understanding and Improving Cross-Cultural Decision Making in Design and Use of Digital Media: A Research Agenda

TagScreen: Synchronizing Social Televisions Through Hidden Sound Markers

The Perfect Technology: Radio and Mobility

Content Synchronization Using Device-to-device Communication in Smart Cities

Human-in-the-Loop Mobile Networks: A Survey of Recent Advancements

Second Screen Synergy: Exploring the Socio-Economic Impact of Dual Screen Engagement in Television Consumption

LSync: A Universal Event-synchronizing Solution for Live Streaming

Effect of the Affordances of the FM New Media Communication Interface Design for Smartphones

On Media Streaming Application Migration in Pervasive Environment