Abstract:BACKGROUND:Regular expression matching (REM) is widely employed as the major tool for deep packet inspection (DPI) applications. For automatic processing, the regular expression patterns need to be converted to a deterministic finite automata (DFA). However, with the ever-increasing scale and complexity of pattern sets, state explosion problem has brought a great challenge to the DFA based regular expression matching. Rule grouping is a direct method to solve the state explosion problem. The original rule set is divided into multiple disjoint groups, and each group is compiled to a separate DFA, thus to significantly restrain the severe state explosion problem when compiling all the rules to a single DFA. OBJECTIVE:For practical implementation, the total number of DFA states should be as few as possible, thus the data structures of these DFAs can be deployed on fast on-chip memories for rapid access. In addition, to support fast pattern update in some applications, the time cost for grouping should be as small as possible. In this study, we aimed to propose an efficient grouping method, which generates as few states as possible with as little time overhead as possible. METHODS:When compiling multiple patterns into a single DFA, the number of DFA states is usually greater than the total number of states when compiling each pattern to a separate DFA. This is mainly caused by the semantic overlaps among different rules. By quantifying the interaction values for each pair of rules, the rule grouping problem can be reduced to the maximum k-cut graph partitioning problem. Then, we propose a heuristic algorithm called the one-step greedy (OSG) algorithm to solve this NP-hard problem. What's more, a subroutine named the heuristic initialization (HI) algorithm is devised to further optimize the grouping algorithms. RESULTS:We employed three practical rule sets for the experimental evaluation. Results show that the OSG algorithm outperforms the state-of-the-art grouping solutions regarding both the total number of DFA states and time cost for grouping. The HI subroutine also demonstrates its significant optimization effect on the grouping algorithms. CONCLUSIONS:The DFA state explosion problem has became the most challenging issue in the regular expression matching applications. Rule grouping is a practical direction by dividing the original rule sets into multiple disjoint groups. In this paper, we investigate the current grouping solutions, and propose a compact and efficient grouping algorithm. Experiments conducted on practical rule sets demonstrate the superiority of our proposal.

Intelligent and Efficient Grouping Algorithms for Large-Scale Regular Expressions

Exploring Efficient Grouping Algorithms in Regular Expression Matching

Intelligent grouping algorithms for regular expressions in deep inspection

Towards Fast and Optimal Grouping of Regular Expressions Via Dfa Size Estimation

P4rex: Accelerating Regular Expression Matching with Programmable Switches

Pattern-Based DFA for Memory-Efficient and Scalable Multiple Regular Expression Matching.

Spectral Clustering Based Regular Expression Grouping

Regular Expression Grouping Algorithm Based on Ant Colony Optimization

Reorganized and Compact DFA for Efficient Regular Expression Matching

Practical Regular Expression Matching Free of Scalability and Performance Barriers

Fast And Memory-Efficient Regular Expression Matching Using Transition Sharing

Towards Fast Regular Expression Matching in Practice

FREME: A Pattern Partition Based Engine for Fast and Scalable Regular Expression Matching in Practice

Efficient Parallelization Of Regular Expression Matching For Deep Inspection

A Technical Survey on Intelligent Optimization Grouping Algorithms for Finite State Automata in Deep Packet Inspection

TCAM-based DFA Deflation: a Novel Approach to Fast and Scalable Regular Expression Matching

Exploring Efficient NFA Data Structures to Accelerate DFA Generation.

Offset-FA: Detach the Closures and Countings for Efficient Regular Expression Matching

Cache-Based Scalable Deep Packet Inspection with Predictive Automaton.

Efficient Matching with Memoization for Regexes with Look-around and Atomic Grouping (Extended Version)

Offset-FA: A Uniform Method to Handle Both Unbounded and Bounded Repetitions in Regular Expression Matching