Abstract:Growing pattern matching applications are employing finite automata as their basic processing model. These applications match tens to thousands of patterns on a large amount of data, which brings a great challenge to conventional processors. Therefore hardware-based solutions have emerged frequently and achieved high throuphput automata processing. However, existing methods are generally difficult to achieve both processing speed and storage efficiency, and are often too heavy to be integrated into a small chip and have to rely on off-chip DRAMs or other high capacity memories even on some simple data sets, leading to the potential area and power consumption issues. In this paper, we focus on building a more lightweight automata processing engine, hoping to store the whole automata model into on-chip memory and run effectively and independently. We propose LAP, a lightweight automata processing engine. Powered with a novel automata model (A-DFA) and efficient packing algorithms, extremely high storage efficiency compared with traditional DFA is achieved in LAP. Meanwhile, we identify the key parallelization factors in the A-DFA model and then propose a specialized microarchitecture with novel instructions to further accelerate the state transition process. As a result, LAP can obtain more effective trade-off between processing speed and storage efficiency. Evaluation results show that LAP achieves extremely high storage efficiency on simple data sets, exceeding IBM's RegX by 8×, and achieves significant improvements in processing speed ranging from 1.32× to 1.91× compared with previous lightweight hardware implementations. Moreover, LAP has good scalability in hardware architecture. It is easy to build an acceleration system with higher throughput by increasing the number of cores. We prototype a 16-core system into Xilinx ZC702 FPGA and a 64-core system into Xilinx ZCU102 FPGA respectively- The prototype system on ZC702 on average achieves 3.5 GB/s throughput on simple data sets, and the prototype system on ZCU102 can obtain higher throughput and compute density values on part of large datasets in ANMLZoo compared with modern in-memory NFA-based solutions.

Pipelined Architecture for Multi-String Matching.

A memory-efficient pipelined implementation of the aho-corasick string-matching algorithm

Pipelined Parallel AC-Based Approach for Multi-String Matching

Multi-Gigabit Rate Pattern-Matching Engine Using Grouping CAM/TCAM

Ultra-High Throughput String Matching for Deep Packet Inspection

Network Processor-Based High Performance String Matching

Accelerating string set matching in FPGA hardware for bioinformatics research

Design of Hardware Pipelining Processor

SCADIS: A Scalable Accelerator for Data-Intensive String Set Matching on FPGAs

Making Multi-String Pattern Matching Scalable and Cost-Efficient with Programmable Switching ASICs

Memory Efficient Algorithm and Architecture for Multi-Pattern Matching

Multiple Regular Expression Matching Hardware Architecture

LAP: A Lightweight Automata Processor for Pattern Matching Tasks

An ultra high throughput and memory efficient pipeline architecture for multi-match packet classification without TCAMs.

Fast String Matching with Overlapped Substring Classifier in Deep Packet Inspection Systems

Multilevel Pattern Matching Architecture for Network Intrusion Detection and Prevention System

A Parameterized Multilevel Pattern Matching Architecture on FPGAs for Network Intrusion Detection and Prevention.

A Fast Multi-pattern Matching Algorithm for Deep Packet Inspection on a Network Processor

A Multiple Simple Regular Expression Matching Architecture and Coprocessor for Deep Packet Inspection

Optimizing multi-thread string matching for network processor based intrusion management system

Enabling Fast and Memory-Efficient Acceleration for Pattern Matching Workloads: The Lightweight Automata Processing Engine