Abstract:In modern high-performance CPUs, the Last Level Cache (LLC) is an important resource, commonly shared by various cores. Technologies like Intel’s Data Direct I/O (DDIO) are also proposed to allocate LLC resources for high-speed I/O, thereby enhancing the I/O performance. We argue that data prefetching can more aggressively improve the LLC utilization for the I/O subsystem. In this paper, we introduce a prefetching scheme for the PCIe-based I/O subsystem integrated a multi-core CPU design. Both the prefetcher and PCIe controller are connected to a coherent interconnect and share the LLC with other cores. The prefetcher monitors bus transactions of the PCIe controller and records its memory accesses split by different pages in the form of delta sequences. When a new access sequence matches the recorded one, prefetch candidates are generated in a recursive manner, called lookahead mechanism, and eventually transformed into cache stashing requests sent to the interconnect to prefetch data from off-chip DDR memory to LLC, hiding the long latency of memory accesses. Based on register transfer level (RTL) design, cycle-accurate full-system simulation results show that, for some typical memory access patterns of PCIe devices, our prefetch-directed scheme can on average reduce latency by 11.3% and increase bandwidth by 12.6%. Logic synthesis results based on an advanced process node also indicate that the area overhead of the prefetcher is only 6.7% of the integrated PCIe subsystem, which is well suited for the chip design of large-scale CPUs.

Design and Implementation of PCIe Physical Layer Elastic-buffer

Research and Development on PCI Bridge IP

A 2-Gb/s/pin Source Synchronous CDMA Bus Interface with Simultaneous Multi-Chip Access and Reconfigurable I/O Capability

Design and implementation of high speed encryption and decryption system based on PCIE bus

Design and FPGA Verification of a Novel Reliable Real-Time Data Transfer System

Fault-Resilient PCIe Bus with Real-time Error Detection and Correction

Design and Implementation of High-throughput PCIe with DMA Architecture between FPGA and PowerPC

Research of the PCI-Express Bus Technology

Research on Hi-Speed Image Data Transmission Channel Based on PCI Bus

EPEE: an efficient PCIe communication library with easy-host-integration property for FPGA accelerators (abstract only).

Design of High-speed Data Transmission System based on PCI Express interface

An efficient and flexible host-FPGA PCIe communication library

Design and Implementation of FPGA Based High-Speed Bus for Control System

Reference Clock Assessment Techniques for PCIe Gen5 and Beyond

Design of a PCIe Interface Card Control Software Based on WDF

Prefetch-directed Scheme for Accelerating Memory Accesses of PCIe-based I/O Subsystem

Development of Low Cost Optical Interconnection Data Link

An Ultra-Low Latency and Compatible PCIe Interconnect for Rack-Scale Communication.

Design of the Physical Coding Sublayer Based on the Ethernet 10Gbase-R Protocol

Design of High-Speed Data Transmission System for IC Test

Design techniques for reference clock jitter optimization for high speed PHYs