Cheshire: A Lightweight, Linux-Capable RISC-V Host Platform for Domain-Specific Accelerator Plug-In

Alessandro Ottaviano,Thomas Benz,Paul Scheffler,Luca Benini

2023-07-06

Abstract:Power and cost constraints in the internet-of-things (IoT) extreme-edge and TinyML domains, coupled with increasing performance requirements, motivate a trend toward heterogeneous architectures. These designs use energy-efficient application-class host processors to coordinate compute-specialized multicore accelerators, amortizing the architectural costs of operating system support and external communication. This brief presents Cheshire, a lightweight and modular 64-bit Linux-capable host platform designed for the seamless plug-in of domain-specific accelerators. It features a unique low-pin-count DRAM interface, a last-level cache configurable as scratchpad memory, and a DMA engine enabling efficient data movement to or from accelerators or DRAM. It also provides numerous optional IO peripherals including UART, SPI, I2C, VGA, and GPIOs. Cheshire's synthesizable RTL description, comprising all of its peripherals and its fully digital DRAM interface, is available free and open-source. We implemented and fabricated Cheshire as a silicon demonstrator called Neo in TSMC's 65nm CMOS technology. At 1.2 V, Neo achieves clock frequencies of up to 325 MHz while not exceeding 300 mW in total power on data-intensive computational workloads. Its RPC DRAM interface consumes only 250 pJ/B and incurs only 3.5 kGE in area for its PHY while attaining a peak transfer rate of 750 MB/s at 200 MHz.

Hardware Architecture

What problem does this paper attempt to address?

The paper aims to address the demand for high-performance, low-power computing platforms in the extreme edge of the Internet of Things (IoT) and TinyML domains. Specifically, this paper proposes a lightweight, modular 64-bit RISC-V host platform named Cheshire, which can seamlessly integrate domain-specific accelerators (DSAs). The main features of Cheshire include: 1. **Unique low-pin-count DRAM interface**: This interface can significantly reduce the cost and complexity of hardware integration. 2. **Last-level cache configurable as static memory**: This design allows the host to have fast internal static random-access memory (SRAM) when needed. 3. **Direct Memory Access (DMA) engine**: This enables efficient data transfer between the host and accelerators or DRAM. 4. **Multiple optional peripherals**: Including UART, SPI, I2C, GPIO modules, and VGA output. Additionally, Cheshire's design is highly flexible and can be configured according to different needs, and its RTL description and FPGA implementation are open-source. The paper also introduces a silicon demonstration version of Cheshire called Neo, which achieved a clock frequency of up to 325MHz under TSMC's 65nm process, while the total power consumption under data-intensive workloads did not exceed 300mW. Its DRAM interface consumes only 250 pJ of energy per byte transferred, achieving a peak transfer rate of 750 MB/s at 200MHz. These features make Cheshire an ideal choice for high-performance, low-power embedded systems.

Cheshire: A Lightweight, Linux-Capable RISC-V Host Platform for Domain-Specific Accelerator Plug-In

X-HEEP: An Open-Source, Configurable and Extendible RISC-V Microcontroller for the Exploration of Ultra-Low-Power Edge Accelerators

Xuantie-910: A Commercial Multi-Core 12-Stage Pipeline Out-of-Order 64-Bit High Performance RISC-V Processor with Vector Extension : Industrial Product

Arnold: an eFPGA-Augmented RISC-V SoC for Flexible and Low-Power IoT End-Nodes

A 28 Nm 0.25-0.61 Mw 31-60Fps Versatile SoC for Diverse Extreme Edge ML Workloads with Flexible Hetero-Fabric Dataflow Orchestration and Compute/Storage-Density-Adjustable CIM

Co-design of a novel CMOS highly parallel, low-power, multi-chip neural network accelerator

A near-threshold RISC-V core with DSP extensions for scalable IoT Endpoint Devices

Marsellus: A Heterogeneous RISC-V AI-IoT End-Node SoC with 2-to-8b DNN Acceleration and 30%-Boost Adaptive Body Biasing

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

AnnikaCore: RISC-V Architecture Processor Design and Implementation for IoT

Culsans: An Efficient Snoop-based Coherency Unit for the CVA6 Open Source RISC-V application processor

A Heterogeneous Microprocessor Based on All-Digital Compute-in-Memory for End-to-End AIoT Inference

Manticore: A 4096-core RISC-V Chiplet Architecture for Ultra-efficient Floating-point Computing

22.1 A 12.4TOPS/W @ 136GOPS AI-IoT System-on-Chip with 16 RISC-V, 2-to-8b Precision-Scalable DNN Acceleration and 30%-Boost Adaptive Body Biasing

TinyVers: A Tiny Versatile System-on-chip with State-Retentive eMRAM for ML Inference at the Extreme Edge

A 101.4 GOPS/W Reconfigurable and Scalable Control-Centric Embedded Processor for Domain-Specific Applications

ANDROMEDA: An FPGA Based RISC-V MPSoC Exploration Framework

HERO: Heterogeneous Embedded Research Platform for Exploring RISC-V Manycore Accelerators on FPGA

Scalable and RISC-V Programmable Near-Memory Computing Architectures for Edge Nodes

A 61 Μa/mhz Reconfigurable Application-Specific Processor and System-on-chip for Internet-of-Things

A Scalable Multi-Chiplet Deep Learning Accelerator with Hub-Side 2.5D Heterogeneous Integration.