Abstract:In a data stream management system (DSMS), users register continuous queries, and receive result updates as data arrive and expire. We focus on applications with real-time constraints, in which the user must receive each result update within a given period after the update occurs. To handle fast data, the DSMS is commonly placed on top of a cloud infrastructure. Because stream properties such as arrival rates can fluctuate unpredictably, cloud resources must be dynamically provisioned and scheduled accordingly to ensure real-time response. It is quite essential, for the existing systems or future developments, to possess the ability of scheduling resources dynamically according to the current workload, in order to avoid wasting resources, or failing in delivering correct results on time. Motivated by this, we propose DRS, a novel dynamic resource scheduler for cloud-based DSMSs. DRS overcomes three fundamental challenges: (a) how to model the relationship between the provisioned resources and query response time (b) where to best place resources; and (c) how to measure system load with minimal overhead. In particular, DRS includes an accurate performance model based on the theory of \emph{Jackson open queueing networks} and is capable of handling \emph{arbitrary} operator topologies, possibly with loops, splits and joins. Extensive experiments with real data confirm that DRS achieves real-time response with close to optimal resource consumption.

An Integrated DBP for Streams with ( M, K )-Firm Real-Time Guarantee

Equivalent Matrix DBP for Streams with (M,k)-Firm Deadline

Extended DBP for (m, K)-Firm Based QoS

Matrix-DBP For (m, k)-firm Real-Time Guarantee

Dynamic management of real time QoS according to (m, k)-firm

Scalability and QoS Guarantee for Streams with (M,k)-Firm Deadline

Enhanced Wfq Algorithm With (M,K)-Firm Guarantee

Priority Based Overlay Multicast With Filtering Mechanism For Distributed Interactive Applications

A Weighted Fair Queuing Scheduling Algorithm With (M,K)-Firm Guarantee

A Weakly Hard Real-Time Schedule Algorithm Based on Cutting Down

Deadline and Priority Constrained Immersive Video Streaming Transmission Scheduling

A Study on Reducing Chunk Scheduling Delay for Mesh-Based P2P Live Streaming

A Real-Time Scheduling Algorithm with Delayed-Preemption Feature for Multimedia Communication

Real-Time Scheduling On Scalable Media Stream Delivery

Deadline-aware Multipath Transmission for Streaming Blocks

Deadline-Aware Transmission Control for Real-Time Video Streaming.

Load Shedding in Stream Databases: A Control-Based Approach.

DRS: Dynamic Resource Scheduling for Real-Time Analytics over Fast Streams

K. h. kim et al.

Dynamic Asynchronous Buffer Management to Improve Data Continuity in P2P Live Streaming

Dynamic Optimization of Random Access in Deadline-Constrained Broadcasting