Abstract:Current pattern-detection proposals for streaming data recognize the need to move beyond a simple regular-expression model over strictly ordered input. We continue in this direction, relaxing restrictions present in some models, removing the requirement for ordered input, and permitting stream revisions (modification of prior events). Further, recognizing that patterns of interest in modern applications may change frequently over the lifetime of a query, we support updating of a pattern specification without blocking input or restarting the operator. Our new pattern operator (called AFA) is a streaming adaptation of a non-deterministic finite automaton (NFA) where additional schema-based user-defined information, called a register , is accessible to NFA transitions during execution. AFAs support dynamic patterns, where the pattern itself can change over time. We propose clean order-agnostic pattern-detection semantics for AFAs, with new algorithms that allow a very efficient implementation, while retaining significant expressiveness and supporting native handling of out-of-order input, stream revisions, dynamic patterns, and several optimizations. Experiments on Microsoft StreamInsight show that we achieve event rates of more than 200K events/sec (up to 5x better than simpler schemes). Our dynamic patterns give up to orders-of-magnitude better throughput than solutions such as operator restart, and our other optimizations are very effective, incurring low memory and latency.

A Multi - Flow Streaming Data Frequent Pattern Mining Adaptive Algorithm

Mining Fuzzy Association Rules in Data Streams

Approximate mining of global closed frequent itemsets over data streams

A New Algorithm for Mining Global Frequent Itemsets in a Stream.

State-of-the-art on Frequent Pattern Mining in Data Streams

Efficient Discovery of Emerging Frequent Patterns in ArbitraryWindows on Data Streams

Estimation and maintenance of frequent pattern on data streams

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

An Algorithm for Data Stream Speed Anomaly Detection Based on RCSW

Parallel Frequent Pattern Discovery: Challenges and Methodology

Survey of the Study on Frequent Pattern Mining in Data Streams

Efficient Mining of Closed Sequential Patterns on Stream Sliding Window

Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

Mining Scalable Pattern Based on Temporal Logic over Data Streams

Mining Algorithm for Frequent Pattern in Data Stream Based on Stream-cube

A Heuristic Method for Unstructured Pattern Management over Data Streams.

A New Algorithm of Mining High Utility Sequential Pattern in Streaming Data

Discovering Significant Sequential Patterns in Data Stream by an Efficient Two-Phase Procedure

High-performance dynamic pattern matching over disordered streams

Efficient Mining of Frequent Sequence Generators

Fuzzy Frequent Pattern Mining Algorithm Based on Weighted Sliding Window and Type-2 Fuzzy Sets over Medical Data Stream