Abstract:Summary form only given. In the PC+ era, a variety of new mobile devices, such as Web-enabled watch, Smartphone, Pocket PC, Tablet PC, etc, are making a population boom. As most of current documents and multimedia contents are designed for applications on desktop PC, we are facing a big challenge - the problem of multiple form factors resulted from the diverse set of emerging new devices. For example, browsing conventional Web pages on Pocket PC is a pain. Browsing a large picture on Smartphone (e.g. picture messaging application) is no different to a thumbnail view, even though the users are now able to capture high-resolution pictures on the latest models of camera-equipped cell phones. Furthermore, enterprise software applications have been aiming to take the advantage of ubiquitous network connection by mobile Internet to increase the productivity of information workers. As the current document-related applications are highly desktop-PC focused, to unleash the power of mobile Internet in the PC+ era, we need to innovate more aggressively and develop a new generation of document and content technologies to cope with the problem of multiple form factors. In this paper, we briefly review the past research and development on adapting multimedia content for heterogeneous device capability, user context and network environment, including the MPEG-7 standard. Then, we focus on the challenge of limited display and input capability in mobile devices, we believe that in order to successfully tackle this challenge, we need to (a) develop new content representation which is scalable and adaptable, (b) develop content analysis techniques to structure content for the new representation, (c) develop corresponding rendering algorithms and innovative user interfaces to maximize the information throughput of the content on small devices, and (d) make content adaptation service part of mobile Internet architecture. We also introduce some specific research works that we have been conducting towards this direction in Microsoft Research Asia. These works include Scalable Web Document which is a new Web content representation for various display sizes, Smart Picture which uses image attention model to facilitate the browsing of large pictures on mobile devices, and Media Compan- ion which uses proxy augmentation on the edge of mobile Internet to construct a content service overlay for dynamic adaptation and value-added services.

Accessing Web Content on Mobile Devices : Relevance , State of the Art and Future Direction

Adaptive Content Delivery on Mobile Internet across Multiple Form Factor.

Challenges and Issues in Adapting Web Contents on Small Screen Devices

Key Techniques for Mobile Internet: a Survey

Design and Performance Studies of an Adaptive Scheme for Serving Dynamic Web Content in a Mobile Computing Environment

Providing Adaptive Dynamic Web Content in Mobile Environment

Mobile Web Browser Optimizations in the Cloud Era: A Survey

Estimating Mobile-Friendliness Scores Of Web Pages

IEEE Access Special Section Editorial: Mobile Edge Computing and Mobile Cloud Computing: Addressing Heterogeneity and Energy Issues of Compute and Network Resources.

Mobile Media Communication, Processing, and Analysis: A Review of Recent Advances

Adaptive mobile web interface: user readiness in context

Chapter 17 MULTIMEDIA ADAPTATION AND BROWSING ON SMALL DISPLAYS

Enabling Offline Access to Facebook Streams on Mobile Devices.

Adaptive Web Browsing on Mobile Heterogeneous Multi-cores

Rethinking HTTP Adaptive Streaming with the Mobile User Perception.

Demystifying Mobile Web Browsing under Multiple Protocols

Efficient browsing of Web search results on mobile devices based on block importance model

Video Streaming To Mobile Handheld Devices: Challenges In Decoding, Adaptation, And Browsing

Adaptive mobile web interface

Rethinking Resource Management in Mobile Web: Measurement, Deployment, and Runtime

Mobile Multimedia Recommendation in Smart Communities: A Survey