A New Information Complexity Measure for Multi-pass Streaming with Applications

Mark Braverman,Sumegha Garg,Qian Li,Shuo Wang,David P. Woodruff,Jiapeng Zhang

2024-03-30

Abstract:We introduce a new notion of information complexity for multi-pass streaming problems and use it to resolve several important questions in data streams.

Computational Complexity,Data Structures and Algorithms

What problem does this paper attempt to address?

Low-complexity frame importance modelling and resource allocation scheme for error-resilience H.264 video streaming

Gang Sun,Wei Xing,Dongming Lu

DOI: https://doi.org/10.1109/MMSP.2008.4665185

2008-01-01

Abstract:In this paper, we addressed the problem of redundancy allocation for protecting packet loss for better quality of service (QoS) in real-time H.264 video streaming. A novel error-resilient approach is proposed for the transmission of pre-encoded H.264 video stream under bandwidth constrained networks. A novel frame importance model is derived for estimating relative importance index for different H.264 video frames. Combining with the characteristics of the network, the optimal resource allocation strategy for different video frames can be determined for achieving improved error resilience. The model uses frame error propagation index (FEPI) to characterize video quality degradation caused by error propagation in different frames in a GOP when suffer from packet loss. This model can be calculated in DCT domain with the parameters extracted directly from the bitstream. Therefore, the complexity of the proposed scheme is very low and much better for real-time video transmission. Simulation results show that the proposed scheme can improve the receiver side reconstructed video quality remarkably under different channel loss patterns.
Green Video Complexity Analysis for Efficient Encoding in Adaptive Video Streaming

Vignesh V Menon,Christian Feldmann,Klaus Schoeffmann,Mohammad Ghanbari,Christian Timmerer

DOI: https://doi.org/10.1145/3593908.3593942

2023-04-25

Abstract:For adaptive streaming applications, low-complexity and accurate video complexity features are necessary to analyze the video content in real time, which ensures fast and compression-efficient video streaming without disruptions. State-of-the-art video complexity features are Spatial Information (SI) and Temporal Information (TI) features which do not correlate well with the encoding parameters in adaptive streaming applications. To this light, Video Complexity Analyzer (VCA) was introduced, determining the features based on Discrete Cosine Transform (DCT)-energy. This paper presents optimizations on VCA for faster and energy-efficient video complexity analysis. Experimental results show that VCA v2.0, using eight CPU threads, Single Instruction Multiple Data (SIMD), and low-pass DCT optimization, determines seven complexity features of Ultra High Definition 8-bit videos with better accuracy at a speed of up to 292.68 fps and an energy consumption of 97.06% lower than the reference SITI implementation.

Multimedia
Delving into Internet Streaming Media Delivery

Lei Guo,Erna Tan,Songqing Chen,Zhen Xiao,Oliver Spatscheck,Xiaodong Zhang

DOI: https://doi.org/10.1145/1177080.1177108

2006-01-01

Abstract:Modern Internet streaming services have utilized various techniques to improve the quality of streaming media delivery. Despite the characterization of media access patterns and user behaviors in many measurement studies, few studies have focused on the streaming techniques themselves, particularly on the quality of streaming experiences they offer end users and on the resources of the media systems that they consume. In order to gain insights into current streaming services techniques and thus provide guidance on designing resource-efficient and high quality streaming media systems, we have collected a large streaming media workload from thousands of broadband home users and business users hosted by a major ISP, and analyzed the most commonly used streaming techniques such as automatic protocol switch, Fast Streaming, MBR encoding and rate adaptation. Our measurement and analysis results show that with these techniques, current streaming systems these techniques tend to over-utilize CPU and bandwidth resources to provide better services to end users, which may not be a desirable and effective is not necessary the best way to improve the quality of streaming media delivery. Motivated by these results, we propose and evaluate a coordination mechanism that effectively takes advantage of both Fast Streaming and rate adaptation to better utilize the server and Internet resources for streaming quality improvement.
Multi-Pass Graph Streaming Lower Bounds for Cycle Counting, MAX-CUT, Matching Size, and Other Problems

Sepehr Assadi,Gillat Kol,Raghuvansh R. Saxena,Huacheng Yu

DOI: https://doi.org/10.1109/focs46700.2020.00041

2020-11-01

Abstract:Consider the following gap cycle counting problem in the streaming model: The edges of a 2-regular $n$-vertex graph $G$ are arriving one-by-one in a stream and we are promised that $G$ is a disjoint union of either $k$-cycles or $2k$-cycles for some small $k$; the goal is to distinguish between these two cases using a limited memory. Verbin and Yu [SODA 2011] introduced this problem and showed that any single-pass streaming algorithm solving it requires $n^{1-\Omega(1/k)}$ space. This result and the proof technique behind it—the Boolean Hidden Hypermatching communication problem—has since been used extensively for proving streaming lower bounds for various problems, including approximating MAX-CUT, matching size, property testing, matrix rank and Schatten norms, streaming unique games and CSPs, and many others. Despite its significance and broad range of applications, the lower bound technique of Verbin and Yu comes with a key weakness that is also inherited by all subsequent results: the Boolean Hidden Hypermatching problem is hard only if there is exactly one round of communication and, in fact, can be solved with logarithmic communication in two rounds. Therefore, all streaming lower bounds derived from this problem only hold for single-pass algorithms. Our goal in this paper is to remedy this state-of-affairs. We prove the first multi-pass lower bound for the gap cycle counting problem: Any $p$-pass streaming algorithm that can distinguish between disjoint union of $k$-cycles vs $2k$-cycles—or even $k$-cycles vs one Hamiltonian cycle-requires $n^{1-1/k^{\Omega(1/p)}}$ space. This makes progress on multiple open questions in this line of research dating back to the work of Verbin and Yu. As a corollary of this result and by simple (or even no) modification of prior reductions, we can extend many of previous lower bounds to multi-pass algorithms. For instance, we can now prove that any streaming algorithm that ($1+\varepsilon$) -approximates the value of MAX-CUT, maximum matching size, or rank of an $n$-by-$n$ matrix, requires either $n^{\Omega(1)}$ space or $\Omega(\log({}^{1}\!/\!_{\varepsilon}))$ passes. For all these problems, prior work left open the possibility of even an $O(\log n)$ space algorithm in only two passes.
Reliable Transmission of Information Hiding Communication Over Stream-Media

Jian Yuan,Yongfeng Huang,Bo Xiao,Baolin Liu

2009-01-01

Journal of Computer Research and Development

Abstract:The authors of this paper first analyze the drawbacks of the transmission mechanism used in the previous streaming media based information hiding communication system.According to the analysis,a new reliable transmission mechanism is proposed,which outperforms the original scheme in term of effective usage of the channel bandwidth.The new mechanism is implemented and tested.Extensive experimental results show that the new mechanism can deal with embedding algorithm which has a very limited capacity,and the algorithms which has certain requirement for the cover media in embedding.
A New One-Pass Complexity-Scalable Computation-Control Method For Video Coding

Weiyao Lin,Krit Panusopone,David M. Baylon,Ming-Ting Sun

DOI: https://doi.org/10.1109/ISCAS.2009.5117894

2009-01-01

Abstract:In this paper, a new Complexity-Scalable computation control method is proposed which can perform Motion Estimation (ME) adaptively under different computation or power budgets while keeping high coding performance. We first propose a new class-based method to measure the Macroblock (MB) importance where MBs are classified into different classes and their importance is measured by combining their class information as well as their initial matching cost information in the ME. Based on the new MB importance measure, a computation control framework is then proposed to allocate computation for ME. Experimental results demonstrate that the proposed method can allocate computation more accurately than previous methods and thus has better performance under the same computation budget.
Tight Bounds for Single-Pass Streaming Complexity of the Set Cover Problem

Sepehr Assadi,Sanjeev Khanna,Yang Li

DOI: https://doi.org/10.48550/arXiv.1603.05715

2016-03-18

Abstract:We resolve the space complexity of single-pass streaming algorithms for approximating the classic set cover problem. For finding an $\alpha$-approximate set cover (for any $\alpha= o(\sqrt{n})$) using a single-pass streaming algorithm, we show that $\Theta(mn/\alpha)$ space is both sufficient and necessary (up to an $O(\log{n})$ factor); here $m$ denotes number of the sets and $n$ denotes size of the universe. This provides a strong negative answer to the open question posed by Indyk et al. (2015) regarding the possibility of having a single-pass algorithm with a small approximation factor that uses sub-linear space. We further study the problem of estimating the size of a minimum set cover (as opposed to finding the actual sets), and establish that an additional factor of $\alpha$ saving in the space is achievable in this case and that this is the best possible. In other words, we show that $\Theta(mn/\alpha^2)$ space is both sufficient and necessary (up to logarithmic factors) for estimating the size of a minimum set cover to within a factor of $\alpha$. Our algorithm in fact works for the more general problem of estimating the optimal value of a covering integer program. On the other hand, our lower bound holds even for set cover instances where the sets are presented in a random order.

Data Structures and Algorithms
Analysis of Multimedia Workloads with Implications for Internet Streaming

Lei Guo,Songqing Chen,Zhen Xiao,Xiaodong Zhang

DOI: https://doi.org/10.1145/1060745.1060821

2005-01-01

Abstract:In this paper, we study the media workload collected from a large number of commercial Web sites hosted by a major ISP and that collected from a large group of home users connected to the Internet via a well-known cable company. Some of our key findings are: (1) Surprisingly, the majority of media contents are still delivered via downloading from Web servers. (2) A substantial percentage of media downloading connections are aborted before completion due to the long waiting time. (3) A hybrid approach, pseudo streaming, is used by clients to imitate real streaming. (4) The mismatch between the downloading rate and the client playback speed in pseudo streaming is common, which either causes frequent playback delays to the clients, or unnecessary traffic to the Internet. (5) Compared with streaming, downloading and pseudo streaming are neither bandwidth efficient nor performance effective. To address this problem, we propose the design of AutoStream, an innovative system that can provide additional previewing and streaming services automatically for media objects hosted on standard Web sites in server farms at the client's will.
Inside the New Coolstreaming: Principles, Measurements and Performance Implications.

Bo Li,Susu Xie,Yang Qu,Gabriel Y. Keung,Chuang Lin,Jiangchuan Liu,Xinyan Zhang

DOI: https://doi.org/10.1109/infocom.2008.157

2008-01-01

Abstract:The Peer-to-Peer (P2P) based video streaming has emerged as a promising solution for Internet video distribution. Leveraging the resource available at end users, this approach poses great potential to scale in the Internet. We have now seen the commercial P2P streaming systems that are orders of magnitude larger than the earlier academic systems. We believe understanding its basic principles and limitations are important in the design of future systems.The Coolstreaming, first released in summer 2004, arguably represented the first successful large-scale P2P live streaming system. Since then, the system has been significantly modified and commercially launched. This paper takes an inside look at the new Coolstreaming system by exposing its design options and rationale behind them, and examines their implications on streaming performance. Specifically, by leveraging a large set of traces obtained from recent live event broadcast and extensive simulations, we study the workload characteristics, system dynamics, and impact from a variety of system parameters. We demonstrate that there is a highly skewed resource distribution in such systems and the performance is mostly affected by the system dynamics. In addition, we show that there are inherent correlations and fundamental trade-off among different system parameters, which can be further explored to enhance the system performance.
Efficient Algorithms for Multi-Sender Data Transmission in Swarm-Based Peer-to-Peer Streaming Systems

Yuanbin Shen,Cheng-Hsin Hsu,Mohamed Hefeeda

DOI: https://doi.org/10.1109/tmm.2011.2108644

IF: 7.3

2011-01-01

IEEE Transactions on Multimedia

Abstract:In mesh-based peer-to-peer (P2P) streaming systems, each video sequence is divided into segments, which are then streamed from multiple senders to a receiver. The receiver needs to coordinate the senders by specifying a transmission schedule for each of them. We consider the problem of scheduling segment transmission in P2P streaming systems, where different segments have different weights in terms of quality improvements to the received video. Our goal is to compute the transmission schedule for each receiver in order to maximize the perceived video quality. We first show that this scheduling problem is NP-Complete. We then present an integer linear programming (ILP) formulation for it, so that it can be solved with any ILP solver. This optimal solution, however, is computationally expensive and is not suitable for real-time P2P streaming systems. Thus, we propose two approximation algorithms to solve this segment scheduling problem. These algorithms provide theoretical guarantees on the worst-case performance. The first algorithm considers the weight of each video segment. The second algorithm is simpler and it assumes that segments carry equal weights. We analyze the performance and complexity of the two algorithms. In addition, we rigorously evaluate the proposed algorithms with simulations and experiments using a prototype implementation. Our simulation and experimental results show that the proposed algorithms outperform other algorithms that are commonly used in deployed P2P streaming systems and that have been recently proposed in the literature.
Multi-Representations Encoding Framework for Adaptive Http Streaming.

Jiawen Gu,Jiangtao Wen,Bichuan Guo,Yuxing Han

DOI: https://doi.org/10.1109/icip.2018.8451251

2018-01-01

Abstract:Adaptive HTTP streaming requires a video to be encoded at multiple representations of different target bitrates. To achieve both smooth streaming and good quality, the representations need to be encoded with accurate rate control and the best quality possible for the target bitrates. However, in practical applications, accurate rate control and good video quality are very difficult to achieve at the same time with one-pass and real-time encoding required by low latency applications. In this paper, we proposed a multi-representation encoding framework that reused the encoding information from low-quality representations to accelerate and optimize higher bitrate encodings. The proposed framework is implemented on two different rate control models, namely R-λ model in HM-16.3 and complexity model in x264, to demonstrate the universality. To be best of our knowledge, the optimization in compression performance of multi - representation is first proposed in this paper. The proposed algorithm can achieve better video quality with only small latency in video coding. Results show that up to 49.6% BDRate savings and 4.43dB BDPSNR improvement are achieved in HM as compared with independent one-pass encodings. Meanwhile, 12.5% time and 14.65% BDRate savings were observed in x264.
Improved Deterministic Streaming Algorithms for Non-monotone Submodular Maximization

Xiaoming Sun,Jialin Zhang,Shuo Zhang

2023-11-07

Abstract:Submodular maximization is one of the central topics in combinatorial optimization. It has found numerous applications in the real world. Streaming algorithms for submodule maximization have gained attention in recent years, allowing for real-time processing of large data sets by looking at each piece of data only once. However, most of the state-of-the-art algorithms are subject to monotone cardinality constraint. There remain non-negligible gaps with respect to approximation ratios between cardinality and other constraints like $d$-knapsack in non-monotone submodular maximization. In this paper, we propose deterministic algorithms with improved approximation ratios for non-monotone submodular maximization. Specifically, for the cardinality constraint, we provide a deterministic $1/6-\epsilon$ approximation algorithm with $O(\frac{k\log k}{\epsilon})$ memory and sublinear query time, while the previous best algorithm is randomized with a $0.1921$ approximation ratio. To the best of our knowledge, this is the first deterministic streaming algorithm for the cardinality constraint. For the $d$-knapsack constraint, we provide a deterministic $\frac{1}{4(d+1)}-\epsilon$ approximation algorithm with $O(\frac{b\log b}{\epsilon})$ memory and $O(\frac{\log b}{\epsilon})$ query time per element. To the best of our knowledge, there is currently no streaming algorithm for this constraint.

Data Structures and Algorithms
A New Edge-Based Complexity Measure for Intra-Rate Estimation in H.264/AVC

Chao Wang,Xuanqin Mou

DOI: https://doi.org/10.1109/icosp.2010.5656048

IF: 4.729

2010-01-01

Signal Processing

Abstract:An efficient I-frame R-Q model is still needed by the rate control in the latest H.264/AVC video coding standard. Some recent works introduced the gradient-based image complexity measure into the frame-layer intra rate estimation in H.264/AVC, but the issue at the macroblock layer was not discussed. We propose a new edge-based complexity measure for this bit rate estimation problem at both the frame-layer and the macroblock-layer. The LOG operator is used in the edge extraction and an adaptive threshold selection method is proposed. The experiments show that the proposed edge-based measure has a good linear relation with the intra frame bit rate.
Settling the Pass Complexity of Approximate Matchings in Dynamic Graph Streams

Sepehr Assadi,Soheil Behnezhad,Christian Konrad,Kheeran K. Naidu,Janani Sundaresan

2024-07-31

Abstract:A semi-streaming algorithm in dynamic graph streams processes any $n$-vertex graph by making one or multiple passes over a stream of insertions and deletions to edges of the graph and using $O(n \cdot \mbox{polylog}(n))$ space. Semi-streaming algorithms for dynamic streams were first obtained in the seminal work of Ahn, Guha, and McGregor in 2012, alongside the introduction of the graph sketching technique, which remains the de facto way of designing algorithms in this model and a highly popular technique for designing graph algorithms in general. We settle the pass complexity of approximating maximum matchings in dynamic streams via semi-streaming algorithms by improving the state-of-the-art in both upper and lower bounds. We present a randomized sketching based semi-streaming algorithm for $O(1)$-approximation of maximum matching in dynamic streams using $O(\log\log{n})$ passes. The approximation ratio of this algorithm can be improved to $(1+\epsilon)$ for any fixed $\epsilon > 0$ even on weighted graphs using standard techniques. This exponentially improves upon several $O(\log{n})$ pass algorithms developed for this problem since the introduction of the dynamic graph streaming model. In addition, we prove that any semi-streaming algorithm (not only sketching based) for $O(1)$-approximation of maximum matching in dynamic streams requires $\Omega(\log\log{n})$ passes. This presents the first multi-pass lower bound for this problem, which is already also optimal, settling a longstanding open question in this area.

Data Structures and Algorithms,Computational Complexity
A New Video Identification Algorithm for Video Stream

Ziqiang Wu,Lei Chen,Xin Liu,Dejian Ye

2009-01-01

Journal of Computer Research and Development

Abstract:Since the emergence of technology of streaming multi-media,it becomes prevalent to obtain services like VOD,live streaming,remote meeting and education from retwork.But some illegal and obscene videos are also available in network which will harm the society.Current methods for identifying the content of video need decode the frame and have high complexity,which is not suitable for real-time detection in places of mass data like gateway and multi-media server.In this paper,a video identification method based on traffic characteristic is presented to detect the media stream from media server in real-time.The prevalent MP4 format media stream is examined using the proposed algorithm and the influence of different parameters in the algorithm on the result is analyzed.The experimental result shows that the method is easy to implement and has a relative satisfactory result in both false positive and false negative in video identification.
Unidirectional Input/Output Streaming Complexity of Reversal and Sorting

Nathanaël François,Rahul Jain,Frederic Magniez

DOI: https://doi.org/10.48550/arXiv.1309.0647

2014-07-18

Abstract:We consider unidirectional data streams with restricted access, such as read-only and write-only streams. For read-write streams, we also introduce a new complexity measure called expansion, the ratio between the space used on the stream and the input size. We give tight bounds for the complexity of reversing a stream of length $n$ in several of the possible models. In the read-only and write-only model, we show that $p$-pass algorithms need memory space ${\Theta}(n/p)$. But if either the output stream or the input stream is read-write, then the complexity falls to ${\Theta}(n/p^2)$. It becomes $polylog(n)$ if $p = O(log n)$ and both streams are read-write. We also study the complexity of sorting a stream and give two algorithms with small expansion. Our main sorting algorithm is randomized and has $O(1)$ expansion, $O(log n)$ passes and $O(log n)$ memory.

Data Structures and Algorithms,Computational Complexity
Efficient and Effective Streaming Technologies for Three-Dimensional Wavelet Compressed Video

Yuan F. Zheng,Jianyu Dong

2002-01-01

Abstract:Video streaming technologies are very important in many applications such as web video, Internet news broadcasting, video-on-demand, etc. Since the Internet is a best-effort network, the quality of the streamed video can not be guaranteed. Therefore, how to improve the quality of service (QoS) of video streaming has become an important research topic. Currently, research effort is primarily focused on the streaming of the MPEG/H.26x video which is commonly supported in commercial products. In comparison, three-dimensional (3-D) wavelet compressed video has not been widely used in streaming applications, but its advantages such as great scalability and error resilience ability have attracted the attention of researchers. Although the long initial delay in 3-D compression makes it unsuitable for interactive real-time applications such as videoconference, we see feasibility to use it in stored video delivery which has more relaxed delay constraint. The objective of our research is to improve both the efficiency and the QoS of the 3-D wavelet video streaming. This dissertation consists of two major topics: a highly efficient transport protocol (AVP) for video streaming and a content-based retransmission mechanism. AVP adopts a novel audio-based synchronization scheme to reduce both the header size and the packet rate while achieving implicit synchronization. As a result, the transmission efficiency is improved and the end-to-end message delay is reduced. Furthermore, AVP provides adaptive QoS by a prioritized packetization scheme. The content-based retransmission mechanism is aimed to increase the error recovery ability of the streaming system. The fundamental idea is to consider the content of the packets and the traffic of the Internet simultaneously to optimize the QoS. In the encoding stage, the content information is generated and stored based on which an intelligent hybrid decision system is designed to perform a two-step optimization. First, the bits used for transmitting each group of video frames (GOF) is dynamically allocated according to the changing traffic conditions such that the quality of video is consistent. Secondly, an intelligent scheme for retransmitting the lost packets is designed to minimize the distortion of video. Based on the research, a new framework is designed to achieve effective and efficient video streaming over lossy networks.
On the Complexity of Processing Massive, Unordered, Distributed Data

Jon Feldman,S. Muthukrishnan,Anastasios Sidiropoulos,Cliff Stein,Zoya Svitkina

DOI: https://doi.org/10.48550/arXiv.cs/0611108

2007-05-22

Abstract:An existing approach for dealing with massive data sets is to stream over the input in few passes and perform computations with sublinear resources. This method does not work for truly massive data where even making a single pass over the data with a processor is prohibitive. Successful log processing systems in practice such as Google's MapReduce and Apache's Hadoop use multiple machines. They efficiently perform a certain class of highly distributable computations defined by local computations that can be applied in any order to the input. Motivated by the success of these systems, we introduce a simple algorithmic model for massive, unordered, distributed (mud) computation. We initiate the study of understanding its computational complexity. Our main result is a positive one: any unordered function that can be computed by a streaming algorithm can also be computed with a mud algorithm, with comparable space and communication complexity. We extend this result to some useful classes of approximate and randomized streaming algorithms. We also give negative results, using communication complexity arguments to prove that extensions to private randomness, promise problems and indeterminate functions are impossible. We believe that the line of research we introduce in this paper has the potential for tremendous impact. The distributed systems that motivate our work successfully process data at an unprecedented scale, distributed over hundreds or even thousands of machines, and perform hundreds of such analyses each day. The mud model (and its generalizations) inspire a set of complexity-theoretic questions that lie at their heart.

Computational Complexity,Distributed, Parallel, and Cluster Computing
Stream Cube: an Architecture for Multi-Dimensional Analysis of Data Streams

Jiawei Han,Yixin Chen,Guozhu Dong,Jian Pei,Benjamin W. Wah,Jianyong Wang,Y. Dora Cai

DOI: https://doi.org/10.1007/s10619-005-3296-1

IF: 0.974

2005-01-01

Distributed and Parallel Databases

Abstract:Real-time surveillance systems, telecommunication systems, and other dynamic environments often generate tremendous (potentially infinite) volume of stream data: the volume is too huge to be scanned multiple times. Much of such data resides at rather low level of abstraction, whereas most analysts are interested in relatively high-level dynamic changes (such as trends and outliers). To discover such high-level characteristics, one may need to perform on-line multi-level, multi-dimensional analytical processing of stream data. In this paper, we propose an architecture, called stream_cube, to facilitate on-line, multi-dimensional, multi-level analysis of stream data. For fast online multi-dimensional analysis of stream data, three important techniques are proposed for efficient and effective computation of stream cubes. First, a tilted time frame model is proposed as a multi-resolution model to register time-related data: the more recent data are registered at finer resolution, whereas the more distant data are registered at coarser resolution. This design reduces the overall storage of time-related data and adapts nicely to the data analysis tasks commonly encountered in practice. Second, instead of materializing cuboids at all levels, we propose to maintain a small number of critical layers. Flexible analysis can be efficiently performed based on the concept of observation layer and minimal interesting layer . Third, an efficient stream data cubing algorithm is developed which computes only the layers (cuboids) along a popular path and leaves the other cuboids for query-driven, on-line computation. Based on this design methodology, stream data cube can be constructed and maintained incrementally with a reasonable amount of memory, computation cost, and query response time. This is verified by our substantial performance study.
A Joint Online Transcoding and Delivery Approach for Dynamic Adaptive Streaming

Zhi Wang,Lifeng Sun,Chuan Wu,Wenwu Zhu,Qidong Zhuang,Shiqiang Yang

DOI: https://doi.org/10.1109/tmm.2015.2425216

IF: 7.3

2015-01-01

IEEE Transactions on Multimedia

Abstract:Dynamic adaptive streaming has emerged as a popular approach for video services in today's Internet. To date, the two important components in dynamic adaptive streaming, video transcoding that generates the adaptive bitrates of a video and video delivery that streams the videos to users, have been separately studied, resulting in a huge waste of computation and storage resource due to producing and caching different versions of videos regardless of their demands. We conduct extensive measurement studies of video sharing systems, including an IPTV service which streams regular, professionally made videos and an instant video clip sharing service which provides extremely short user-generated videos, as well as the availability of computation resource in conventional content delivery networks (CDNs). Based on the measurement insights, we propose an online joint transcoding and delivery approach for adaptive video streaming. We formulate optimization problems to enable high streaming quality for the users, and low computation and replication costs for the system. In particular, our strategy connects video transcoding and video delivery based on users' preferences of CDN regions and regional preferences of video versions. We analyze hardness of these problems and design distributed solutions. Extensive trace-driven experiments further demonstrate the superiority of our design.

A New Information Complexity Measure for Multi-pass Streaming with Applications

Low-complexity frame importance modelling and resource allocation scheme for error-resilience H.264 video streaming

Green Video Complexity Analysis for Efficient Encoding in Adaptive Video Streaming

Delving into Internet Streaming Media Delivery

Multi-Pass Graph Streaming Lower Bounds for Cycle Counting, MAX-CUT, Matching Size, and Other Problems

Reliable Transmission of Information Hiding Communication Over Stream-Media

A New One-Pass Complexity-Scalable Computation-Control Method For Video Coding

Tight Bounds for Single-Pass Streaming Complexity of the Set Cover Problem

Analysis of Multimedia Workloads with Implications for Internet Streaming

Inside the New Coolstreaming: Principles, Measurements and Performance Implications.

Efficient Algorithms for Multi-Sender Data Transmission in Swarm-Based Peer-to-Peer Streaming Systems

Multi-Representations Encoding Framework for Adaptive Http Streaming.

Improved Deterministic Streaming Algorithms for Non-monotone Submodular Maximization

A New Edge-Based Complexity Measure for Intra-Rate Estimation in H.264/AVC

Settling the Pass Complexity of Approximate Matchings in Dynamic Graph Streams

A New Video Identification Algorithm for Video Stream

Unidirectional Input/Output Streaming Complexity of Reversal and Sorting

Efficient and Effective Streaming Technologies for Three-Dimensional Wavelet Compressed Video

On the Complexity of Processing Massive, Unordered, Distributed Data

Stream Cube: an Architecture for Multi-Dimensional Analysis of Data Streams

A Joint Online Transcoding and Delivery Approach for Dynamic Adaptive Streaming