Abstract:The pervasive computing environment and wide network bandwidth provide users more opportunities to share screen content among multiple devices. In this article, we introduce a remote display system to enable screen sharing among multiple devices with high fidelity and responsive interaction. In the developed system, the frame-level screen content is compressed and transmitted to the client side for screen sharing, and the instant control inputs are simultaneously transmitted to the server side for interaction. Even if the screen responds immediately to the control messages and updates at a high frame rate on the server side, it is difficult to update the screen content with low delay and high frame rate in the client side due to non-negligible time consumption on the whole screen frame compression, transmission, and display buffer updating. To address this critical problem, we propose a layered structure for screen coding and rendering to deliver diverse screen content to the client side with an adaptive frame rate. More specifically, the interaction content with small region screen update is compressed by a blockwise screen codec and rendered at a high frame rate to achieve smooth interaction, while the natural video screen content is compressed by standard video codec and rendered at a regular frame rate for a smooth video display. Experimental results with real applications demonstrate that the proposed system can successfully reduce transmission bandwidth cost and interaction delay during screen sharing. Especially for user interaction in small regions, the proposed system can achieve a higher frame rate than most previous counterparts.

A Capture-to-display Delay Measurement System for Visual Communication Applications

MEASUREMENT OF LATENCY ON VISUAL FEEDBACK IN AN IMMERSIVE TELEPRESENCE ROBOTIC SYSTEM

CCD-based system for two-dimensional measurement of color uniformity of LCD projector

Ccd High Speed Videography System With New Concepts And Techniques

A Streaming-Based Approach for Remote Interaction of the Multi-Channel Display System for Group Users

On Display-Camera Synchronization for Visible Light Communication

Long-Distance, Real-Time LED Display-Camera Communication System Based on LED Point Clustering and Lightweight Image Processing

The Research for Real-time Display of Asynchronous Multi-channel CCD Camera Image

Demonstration Of A Covert Camera-Screen Communication System

A Hardware-Accelerated System for High Resolution Real-Time Screen Sharing.

A Systematic Scheme for Measuring the Performance of the Display-Camera Channel

A High-Fidelity and Low-Interaction-Delay Screen Sharing System

Synchronization Detection of Multicamera System Based on Led Matrix

Design and Experimental Demonstration of a Real-Time 95kbps Optical Camera Communication System

End-to-end Delay Reduction Technique for Videoconferencing over Wireless Campus Networks

Time-based Assessment for H.264 Decoder

InFrame++: Achieve Simultaneous Screen-Human Viewing and Hidden Screen-Camera Communication.

A Scalable Video Conferencing System Using Cached Facial Expressions.

Design and Implementation of Wireless UWB Video Monitor System

Motion-Aware Optical Camera Communication with Event Cameras

Demo: Achieving Simultaneous Screen-Human Viewing and Hidden Screen-Camera Communication.