Abstract:Memory resources in data centers generally suffer from low utilization and lack of dynamics. Memory disaggregation solves these problems by decoupling CPU and memory, which currently includes approaches based on RDMA or interconnection protocols such as Compute Express Link (CXL). However, the RDMA-based approach involves code refactoring and higher latency. The CXL-based approach supports native memory semantics and overcomes the shortcomings of RDMA, but is limited within rack level. In addition, memory pooling and sharing based on CXL products are currently in the process of early exploration and still take time to be available in the future. In this paper, we propose the CXL over Ethernet approach that the host processor can access the remote memory with memory semantics through Ethernet. Our approach can support native memory load/store access and extends the physical range to cross server and rack levels by taking advantage of CXL and RDMA technologies. We prototype our approach with one server and two FPGA boards with 100 Gbps network and measure the memory access latency. Furthermore, we optimize the memory access path by using data cache and congestion control algorithm in the critical path to further lower access latency. The evaluation results show that the average latency for the server to access remote memory is 1.97 {\mu}s, which is about 37% lower than the baseline latency in the industry. The latency can be further reduced to 415 ns with cache block and hit access on FPGA.

High-speed Network Access Technology Based on DDR Memory Bus

Design of the DDR SDRAM Controller Integrated by the Data Intensive Computing Architecture

Design of Optical Interconnection Network Adapter Based on DDR DIMM Bus for Cluster System

Research of the High-Speed Fibre Switch Network NIC Based on the Memory Communication

Design of High-Speed Data Transmission System for IC Test

Architecture design and performance analysis of a novel memory system for high-bandwidth onboard switching fabric

Design of High-Speed Data Buffer Based on FPGA for Gigabit-Rate Exchange Devices

Research of the Direct Memory Communication Method

CXL over Ethernet: A Novel FPGA-based Memory Disaggregation Design in Data Centers

High Throughput Memory Data-Path Design For Multi-Core Architecture

Design of DDR2 SDRAM Memory User Interface Based on FPGA

A 2-Gb/s/pin Source Synchronous CDMA Bus Interface with Simultaneous Multi-Chip Access and Reconfigurable I/O Capability

Structure design of data buffer for high-speed exchange devices

The Design of a High Speed and Reliable Data Center Based on FPGA

Design And Implementation Of A High-Performance Interconnection Network: Th-Net

A Novel Free-memory Communication Interface of Many Cores Processor

Design and Implementation of High Speed Interconnection for Workstation Cluster System

Design and Implementation of an AHB-based High-Speed Memory Access Layer

Using Direct Cache Access Combined with Integrated NIC Architecture to Accelerate Network Processing

Design of the Reflective Memory Card Based on PCI Bus

Fpga Implementation Of Hierarchical Memory Architecture For Network Processors