Abstract:The financial market server in exchanges aims to maintain the order books and provide real time market data feeds to traders. Low-latency processing is in a great demand in financial trading. Although software solutions provide the flexibility to express algorithms in high-level programming models and to recompile quickly, it is becoming increasingly uncompetitive due to the long and unpredictable response time. Nowadays, Field Programmable Gate Arrays (FPGAs) have been proved to be an established technology for achieving a low and constant latency for processing streaming packets in a hardware accelerated way. However, maintaining order books on FPGAs involves organizing packets into GBs of structural data information as well as complicated routines (sort, insertion, deletion, etc.), which is extremely challenging to FPGA designs in both design methodology and memory volume. Thus existing FPGA designs often leave the post-processing part to the CPUs. However, it largely cancels the latency gain of the network packet processing part. This paper proposes a CPU-FPGA hybrid list design to accelerate financial market servers that achieve microsecond-level latencies. This paper mainly includes four contributions. First, we design a CPU-FPGA hybrid list with two levels, a small cache list on the FPGA and a large master list at the CPU host. Both lists are sorted with different sorting schemes, where the bitonic sort is applied to the cache list while a balanced tree is used to maintain the master list. Second, in order to effectively update the hybrid sorted list, we derive a complete set of low-latency routines, including insertion, deletion, selection, sorting, etc., providing a low latency at the scale of a few cycles. Third, we propose a non-blocking on-demand synchronization strategy for the cache list and the master list to communicate with each other. Lastly, we integrate the hybrid list as well as other components, such as packets splitting, parsing, processing, etc. to form an industry-level financial market server. Our design is applied in the environment of the China Financial Futures Exchange (CFFEX), demonstrating its functionality and stability by running 600+ hours with hundreds of millions packets per day. Compared with the existing CPU-based solution in CFFEX, our system is able to support identical functionalities while significantly reducing the latency from 100+ microseconds to 2 microseconds, gaining a speedup of 50x.

A New CPU-FPGA Heterogeneous gStore System

Engaging Heterogeneous FPGAs in the Cloud.

FPGA-Accelerated Compactions for LSM-based Key-Value Store.

Resource-Efficient Parallel Tree-Based Join Architecture on FPGA

Ultra-Low-Latency and Flexible In-memory Key-Value Store System Design on CPU-FPGA

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

A Hybrid Approach to Cache Management in Heterogeneous CPU-FPGA Platforms.

Integrating FPGA-based hardware acceleration with relational databases

L-FNNG: Accelerating Large-Scale KNN Graph Construction on CPU-FPGA Heterogeneous Platform

HeteroKV: A Scalable Line-rate Key-Value Store on Heterogeneous CPU-FPGA Platforms.

Heterogeneous Cloud Framework for Big Data Genome Sequencing.

A Low-Latency Multi-Version Key-Value Store Using B-Tree on an FPGA-CPU Platform.

Accelerating Graph Analytics by Co-Optimizing Storage and Access on an FPGA-HMC Platform

Memory Coherency Based CPU-Cache-FPGA Acceleration Architecture for Cloud Computing

Accelerating Financial Market Server Through Hybrid List Design (abstract Only)

FASI: FPGA-friendly Subgraph Isomorphism on Massive Graphs.

Accelerating Monte-Carlo Tree Search on CPU-FPGA Heterogeneous Platform

Parallel Sparse LU Decomposition Using FPGA with an Efficient Cache Architecture.

A multi-FPGA based platform for emulating a 100m-transistor-scale processor with high-speed peripherals (abstract only)

High-Parallelism and Pipelined Architecture for Accelerating Sort-Merge Join on FPGA

Hardware Thread Accelerating Method Based on CPU/FPGA Hybrid Architecture