Abstract:With the rapid growth of network bandwidth, increases in CPU cores on a single machine, and application API models demanding more short-lived connections, a scalable TCP stack is performance-critical. Although many clean-state designs have been proposed, production environments still call for a bottom-up parallel TCP stack design that is backward-compatible with existing applications. We present Fastsocket, a BSD Socket-compatible and scalable kernel socket design, which achieves table-level connection partition in TCP stack and guarantees connection locality for both passive and active connections. Fastsocket architecture is a ground up partition design, from NIC interrupts all the way up to applications, which naturally eliminates various lock contentions in the entire stack. Moreover, Fastsocket maintains the full functionality of the kernel TCP stack and BSD-socket-compatible API, and thus applications need no modifications. Our evaluations show that Fastsocket achieves a speedup of 20.4x on a 24-core machine under a workload of short-lived connections, outperforming the state-of-the-art Linux kernel TCP implementations. When scaling up to 24 CPU cores, Fastsocket increases the throughput of Nginx and HAProxy by 267% and 621% respectively compared with the base Linux kernel. We also demonstrate that Fastsocket can achieve scalability and preserve BSD socket API at the same time. Fastsocket is already deployed in the production environment of Sina WeiBo, serving 50 million daily active users and billions of requests per day.

The Design of Embedded Socket Software

Design of an Embedded Real-Time Operating System

The Design and Implementation of Network Communication Software Based on Java

Design and Realization of Application Interface Between Real-Time Database and Industrial Process Control System

The Design of Host-Computer Software for the EPA Control Net

Design of Embedded Network Control System Based on LwIP Protocol Stack

The Design of Remote Supervisory System Based on Embedded Internet

Intelligence-networked Automatic Instrumentation Based on an Embedded

DESIGN AND IMPLEMENTATION OF CONET V2.0

Design of Emodem's Software and Hardware on the Embedded Equipment

The Study And Design Of Embedded Real-Time Operating System Based On 80c196kc

An Empirical Study of the GUI Development of Embedded NC System

Research on the Application of Embedded Real-time Software in Computer Software Design

Preliminary study of network scheduling mechanism in ubiquitous operating system

The system software design of the embedded remote video monitor system based on GPRS

Network Programming Technique and Its Realization Based on Socket

Data Acquisition and Distributed Computing System Based on Embedded Network

An improved RUDP for data transmission in embedded real-time system

The Research and Analysis of Embedded TCP/IP Protocol

Scalable Kernel TCP Design and Implementation for Short-Lived Connections.

GUI System Based on the Communication Mechanism of Qte