Abstract:The widespread deployment of storage disaggregation in the cloud has facilitated flexible scaling and storage overprovisioning, allowing for high utilization of storage capacity and IOPS. Instead of utilizing remote storage protocols to access remote disks, a middle-tier is introduced between compute servers and storage servers in order to serve I/O requests from compute servers and provide computations such as compression and decompression. However, due to the need for a cloud to concurrently serve millions of VMs that require access to disaggregated storage, the middle-tier requires a massive number of servers to process network traffic between computing and storage nodes. For example, a major cloud company may deploy hundreds of thousands of high-end servers to provide such a service for its cloud storage, because the existing CPU-based middle-tier suffers from a severe issue of compute-intensive compression/decompression on high-throughput storage traffic. To address this issue, we introduce SmartDS, a middle-tier-centric SmartNIC that serves storage I/O requests with low latency and high throughput, while maintaining high flexibility and programmability. The key idea behind SmartDS is the application-aware message split (AAMS) mechanism, which allows for the processing of the message's header on the host CPU to achieve high flexibility, and the message's payload on the SmartDS. Experimental results demonstrate that SmartDS provides up to 4.3x more throughput than a CPU-based middle-tier and enables the linear scale-up of multiple network ports and multiple SmartNICs, thus significantly reducing cloud infrastructure costs for disaggregated block storage.

OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs

High-Baudrate SiP and InP Modulators for Data Center Interconnects

Performance Characterization of SmartNIC NVMe-over-Fabrics Target Offloading

A Comprehensive Survey on SmartNICs: Architectures, Development Models, Applications, and Research Directions

Janus: An Experimental Reconfigurable SmartNIC with P4 Programmability and SDN Isolation

Meili: Enabling SmartNIC as a Service in the Cloud

A Comprehensive Study on Optimizing Systems with Data Processing Units

Tide: A Split OS Architecture for Control Plane Offloading

Silicon Photonic Network-on-chip and Enabling Components

Mitigating Intra-host Network Congestion with SmartNIC

SmartDS: Middle-Tier-centric SmartNIC Enabling Application-aware Message Split for Disaggregated Block Storage.

Multitenancy for Fast and Programmable Networks in the Cloud.

Adaptive SmartNIC Offloading for Unleashing the Performance of Protocol-Oblivious Forwarding

A Gigabit, DMA-enhanced Open-Source Ethernet Controller for Mixed-Criticality Systems

JingZhao: A Framework for Rapid NIC Prototyping in the Domain-Specific-Network Era

Enabling multi-tenancy in hybrid optical packet/circuit switched data center networks

Hybrid Packet/Fine-Grained-Optical Switching Architectures for Future Large-Scale Data Center Networks

SmartChain: Enabling High-Performance Service Chain Partition Between SmartNIC and CPU.

Efficient, Dynamic Multi-tenant Edge Computation in EdgeOS

ORCA: A Network and Architecture Co-design for Offloading us-scale Datacenter Applications

An Ultra-Low Latency and Compatible PCIe Interconnect for Rack-Scale Communication.