Abstract:Since its establishment in 2009, the Center for Domain-Specific Computing (CDSC) has focused on customizable computing. We believe that future computing systems will be customizable with extensive use of accelerators, as custom-designed accelerators often provide 10–100X performance/energy efficiency over the general-purpose processors. Such an accelerator-rich architecture presents a fundamental departure from the classical von Neumann architecture, which emphasizes efficient sharing of the executions of different instructions on a common pipeline, providing an elegant solution when the computing resource is scarce. In contrast, the accelerator-rich architecture features heterogeneity and customization for energy efficiency; this is better suited for energy-constrained designs where the silicon resource is abundant and spatial computing is favored—which has been the case with the end of Dennard scaling. Currently, customizable computing has garnered great interest; for example, this is evident by Intel’s $17 billion acquisition of Altera in 2015 and Amazon’s introduction of field-programmable gate-arrays (FPGAs) in its AWS public cloud. In this paper, we present an overview of the research programs and accomplishments of CDSC on customizable computing, from single chip to server node and to datacenters, with extensive use of composable accelerators and FPGAs. We highlight our successes in several application domains, such as medical imaging, machine learning, and computational genomics. In addition to architecture innovations, an equally important research dimension enables automation for customized computing. This includes automated compilation for combining source-code-level transformation for high-level synthesis with efficient parameterized architecture template generations, and efficient runtime support for scheduling and transparent resource management for integration of FPGAs for datacenter-scale acceleration with support to the existing programming interfaces, such as MapReduce, Hadoop, and Spark, for large-scale distributed computation. We will present the latest progress in these areas, and also discuss the challenges and opportunities ahead.

Modular High-Performance Computing Using Chiplets

Chiplets and the Codelet Model

The evolution of heterogeneous integration and packaging for the age of chiplets

Challenges and Opportunities to Enable Large-Scale Computing via Heterogeneous Chiplets

A Scalable Multi-Chiplet Deep Learning Accelerator with Hub-Side 2.5D Heterogeneous Integration.

Educating for Hardware Specialization in the Chiplet Era: A Path for the HPC Community

Advanced Packaging: Enabling Moore’s Law’s Next Frontier Through Heterogeneous Integration

RapidChiplet: A Toolchain for Rapid Design Space Exploration of Chiplet Architectures

OLAP on Modern Chiplet-Based Processors

Furthering Moore’s Law Integration Benefits in the Chiplet Era

Monad: Towards Cost-effective Specialization for Chiplet-based Spatial Accelerators

Enabling High-Performance Heterogeneous Integration via Interface Standards, IP Reuse, and Modular Design

Computing Utilization Enhancement for Chiplet-based Homogeneous Processing-in-Memory Deep Learning Processors

Advanced Packaging Technology Platforms for Chiplets and Heterogeneous Integration

Architecture of Computing System based on Chiplet

IntAct: A 96-Core Processor With Six Chiplets 3D-Stacked on an Active Interposer With Distributed Interconnects and Integrated Power Management

HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement

Massive Data-Centric Parallelism in the Chiplet Era

Customizable Computing—From Single Chip to Datacenters

Inter-Layer Scheduling Space Exploration for Multi-model Inference on Heterogeneous Chiplets

Reinventing High Performance Computing: Challenges and Opportunities