Abstract:Although many scalable event matching algorithms have been proposed to achieve scalability for large-scale content-based networks, content-based publish/subscribe networks (especially for large-scale real time systems) still suffer performance deterioration when subscription scale increases. While subscription aggregation techniques can be useful to reduce the amount of subscription dissemination traffic and the subscription table size by exploiting the similarity among subscriptions, efficient subscription aggregation is not a trivial task to accomplish. Previous research works have proved that it is either a NP-Complete or a co-NP complete problem. In this paper, we propose DLS (Discrete Label Set), a novel subscription representation model, and design algorithms to achieve the mapping from traditional Boolean predicate model to the DLS model. Based on the DLS model, we propose a subscription aggregation algorithm with O(1) time complexity in most cases, and an event matching algorithm with O(1) time complexity. The significant performance improvement is at the cost of memory consumption and controllable false positive rate. Our theoretical analysis shows that these algorithms are inherently scalable and can achieve real time event matching in a large-scale content-based publish/subscribe network. We discuss the tradeoff between memory, false positive rate and partition granules of content space. Experimental results show that proposed algorithms achieve expected performance. With the increasing of computer memory capacity and the dropping of memory price, more and more large-scale real time applications can benefit from our proposed DLS model, such as stock quote distribution, earthquake monitoring, and severe weather alert.

RRPS: A Ranked Real-Time Publish/Subscribe Using Adaptive QoS

Achieving Real-Time Quality of Service with Software Defined Networking

Quality of Experience Modeling and Fair Scheduling for Instant Messaging Service

An Efficient Publish/Subscribe Index for E-Commerce Databases

Towards A Quality-Oriented Real-Time Web Crawler

Dynamic management of real time QoS according to (m, k)-firm

QoS Allocation Algorithms for Publish-Subscribe Information Space Middleware

Scalability and QoS Guarantee for Streams with (M,k)-Firm Deadline

Resource Allocation and Scheduling Algorithm for Wireless Communication System with QoS Guaranteed

Analysis and Evaluation of Real-time Performance of Publish/Subscribe Communication Mode

A Fuzzy QoS-aware Resource Service Selection Considering Design Preference in Cloud Manufacturing System

Modeling Service Quality for Dynamic QoS Publishing

Towards Scalable Subscription Aggregation and Real Time Event Matching in a Large-Scale Content-Based Network

Collective Real-Time QoS in Wireless Sensor Networks

Adaptive Resource Management for P2P Live Streaming Systems

A QoS-Aware Scheduling Algorithm for High-Speed Railway Communication System

An RDF-Based Publish/Subscribe System

Research and Design Ofa Real-TimeMiddleware Based on DDS

Efficient Filtering Algorithms for Location-Aware Publish/Subscribe.

DRS: Dynamic Resource Scheduling for Real-Time Analytics over Fast Streams

QoS-aware Placement of Stream Processing Service