Research Note: An Open Source Bluespec Compiler

David J. Greaves

DOI: https://doi.org/10.48550/arXiv.1905.03746

2019-05-08

Programming Languages

Abstract:In this Research Note we report on an open-source compiler for the Bluespec hardware description language.

What problem does this paper attempt to address?

The essence of Bluespec: a core language for rule-based hardware design

Thomas Bourgeat,Clément Pit-Claudel,Adam Chlipala,Arvind

DOI: https://doi.org/10.1145/3385412.3385965

2020-06-06

Abstract:The Bluespec hardware-description language presents a significantly higher-level view than hardware engineers are used to, exposing a simpler concurrency model that promotes formal proof, without compromising on performance of compiled circuits. Unfortunately, the cost model of Bluespec has been unclear, with performance details depending on a mix of user hints and opaque static analysis of potential concurrency conflicts within a design. In this paper we present Koika, a derivative of Bluespec that preserves its desirable properties and yet gives direct control over the scheduling decisions that determine performance. Koika has a novel and deterministic operational semantics that uses dynamic analysis to avoid concurrency anomalies. Our implementation includes Coq definitions of syntax, semantics, key metatheorems, and a verified compiler to circuits. We argue that most of the extra circuitry required for dynamic analysis can be eliminated by compile-time BSV-style static analysis.
SpecTest: Specification-Based Compiler Testing

Richard Schumi,Jun Sun

DOI: https://doi.org/10.1007/978-3-030-71500-7_14

2021-01-01

Abstract:Abstract Compilers are error-prone due to their high complexity. They are relevant for not only general purpose programming languages, but also for many domain specific languages. Bugs in compilers can potentially render all programs at risk. It is thus crucial that compilers are systematically tested, if not verified. Recently, a number of efforts have been made to formalise and standardise programming language semantics, which can be applied to verify the correctness of the respective compilers. In this work, we present a novel specification-based testing method named SpecTest to better utilise these semantics for testing. By applying an executable semantics as test oracle, SpecTest can discover deep semantic errors in compilers. Compared to existing approaches, SpecTest is built upon a novel test coverage criterion called semantic coverage which brings together mutation testing and fuzzing to specifically target less tested language features. We apply SpecTest to systematically test two compilers, i.e., the Java compiler and the Solidity compiler. SpecTest improves the semantic coverage of both compilers considerably and reveals multiple previously unknown bugs.
Toward an Open-Source Digital Flow

Tutu Ajayi,Vidya A. Chhabria,Mateus Fogaca,Soheil Hashemi,Abdelrahman Hosny,Andrew B. Kahng,Minsoo Kim,Jeongsup Lee,Uday Mallappa,Marina Neseem,Geraldo Pradipta,Sherief Reda,Mehdi Saligane,Sachin S. Sapatnekar,Carl Sechen,Mohamed Shalan,William Swartz,Lutong Wang,Zhehong Wang,Mingyu Woo,Bangqi Xu

DOI: https://doi.org/10.1145/3316781.3326334

2019-01-01

Abstract:We describe the planned Alpha release of OpenROAD, an open-source end-to-end silicon compiler. OpenROAD will help realize the goal of "democratization of hardware design", by reducing cost, expertise, schedule and risk barriers that confront system designers today. The development of open-source, self-driving design tools is in and of itself a "moon shot" with numerous technical and cultural challenges. The open-source flow incorporates a compatible open-source set of tools that span logic synthesis, floorplanning, placement, clock tree synthesis, global routing and detailed routing. The flow also incorporates analysis and support tools for static timing analysis, parasitic extraction, power integrity analysis, and cloud deployment. We also note several observed challenges, or "lessons learned", with respect to development of open-source EDA tools and flows.
Preprint: Open Source Compiling for V1Model RMT Switch: Making Data Center Networking Innovation Accessible

Debobroto Das Robin,Javed I. Khan

DOI: https://doi.org/10.48550/arXiv.2211.11916

2022-11-21

Networking and Internet Architecture

Abstract:Very few of the innovations in deep networking have seen data center scale implementation. Because the Data Center network's extreme scale performance requires hardware implementation, which is only accessible to a few. However, the emergence of reconfigurable match-action table (RMT) paradigm-based switches have finally opened up the development life cycle of data plane devices. The P4 language is the dominant language choice for programming these devices. Now, Network operators can implement the desired feature over white box RMT switches. The process involves an innovator writing new algorithms in the P4 language and getting them compiled for the target hardware. However, there is still a roadblock. After designing an algorithm, the P4 program's compilation technology is not fully open-source. Thus, it is very difficult for an average researcher to get deep insight into the performance of his/her innovation when executed at the silicon level. There is no open-source compiler backend available for this purpose. Proprietary compiler backends provided by different hardware vendors are available for this purpose. However, they are closed-source and do not provide access to the internal mapping mechanisms. Which inhibits experimenting with new mapping algorithms and innovative instruction sets for reconfigurable match-action table architecture. This paper describes our work toward an open-source compiler backend for compiling P416 targeted for the V1Model architecture-based programmable switches.
Defining Name Accessibility using Scope Graphs (Extended Edition)

Aron Zwaan,Casper Bach Poulsen

2024-07-12

Abstract:Many programming languages allow programmers to regulate accessibility; i.e., annotating a declaration with keywords such as export and private to indicate where it can be accessed. Despite the importance of name accessibility for, e.g., compilers, editor auto-completion and tooling, and automated refactorings, few existing type systems provide a formal account of name accessibility. We present a declarative, executable, and language-parametric model for name accessibility, which provides a formal specification of name accessibility in Java, C#, C++, Rust, and Eiffel. We achieve this by defining name accessibility as a predicate on resolution paths through scope graphs. Since scope graphs are a language-independent model of name resolution, our model provides a uniform approach to defining different accessibility policies for different languages. Our model is implemented in Statix, a logic language for executable type system specification using scope graphs. We evaluate its correctness on a test suite that compares it with the C#, Java, and Rust compilers, and show we can synthesize access modifiers in programs with holes accurately.

Programming Languages
Research on Open-Source Hardware Based Design Method

Mai Song-Ping,Zhang Chun,Yang Kun,Wang Zhi-Hua

2007-01-01

Abstract:Reusability is the key element in today’s VLSI design. Open-source hardware provides a more thorough and effective way for design reusability than traditional charged closed-source IP by sharing its design documents and IP modules. And open-source hardware based SoC design method is being accepted and practiced by more and more designers. This paper introduces relative concepts, benefits, problems and perspectives of open-source hardware in detail, and discusses open-source hardware based design flow in depth by exampling an open-source processor design.
An open-source P4 16 compiler backend for reconfigurable match-action table switches: Making networking innovation accessible

Debobroto Das Robin,Javed I. Khan

DOI: https://doi.org/10.1016/j.comnet.2024.110246

IF: 5.493

2024-02-15

Computer Networks

Abstract:Recently emerging reconfigurable match-action table (RMT) paradigm-based switches coupled with P4 programming language have opened up the development life cycle of network data plane devices. However, there is no open-source P4 compiler backend available for RMT switches. Thus, it is very difficult for an researcher/developer to get deep insight into the performance of his/her algorithm when executed at the silicon level. Proprietary, closed-source compiler backends from hardware vendors do not provide access to the internal mapping mechanisms. Which inhibits experimenting with new mapping algorithms and innovative instruction sets for reconfigurable match-action table architecture. This paper describes our work toward an open-source compiler backend to enable innovation in this domain. It is capable of compiling a P4 program for the V1Model architecture, which is the most widely available realization of the RMT paradigm. It provides open intelligence about the P4 program's critical performance metrics (processing latency, resource usage, etc.) at the silicon level. As an open-source extendable platform, it allows researchers to experiment with different internal components of a compiler backend. To the best of our knowledge, this is the first complete open-source P4 16 (the latest version of P4 language) compiler backend for the V1Model architecture-based programmable switches.

computer science, information systems,telecommunications,engineering, electrical & electronic, hardware & architecture
Towards Porting Operating Systems with Program Synthesis

Jingmei Hu,Eric Lu,David A. Holland,Ming Kawaguchi,Stephen Chong,Margo Seltzer

DOI: https://doi.org/10.1145/3563943

IF: 1.714

2023-03-03

ACM Transactions on Programming Languages and Systems

Abstract:The end of Moore’s Law has ushered in a diversity of hardware not seen in decades. Operating system (OS) (and system software) portability is accordingly becoming increasingly critical. Simultaneously, there has been tremendous progress in program synthesis. We set out to explore the feasibility of using modern program synthesis to generate the machine-dependent parts of an operating system. Our ultimate goal is to generate new ports automatically from descriptions of new machines. One of the issues involved is writing specifications, both for machine-dependent operating system functionality and for instruction set architectures. We designed two domain-specific languages: Alewife for machine-independent specifications of machine-dependent operating system functionality and Cassiopea for describing instruction set architecture semantics. Automated porting also requires an implementation. We developed a toolchain that, given an Alewife specification and a Cassiopea machine description, specializes the machine-independent specification to the target instruction set architecture and synthesizes an implementation in assembly language with a customized symbolic execution engine. Using this approach, we demonstrate the successful synthesis of a total of 140 OS components from two pre-existing OSes for four real hardware platforms. We also developed several optimization methods for OS-related assembly synthesis to improve scalability. The effectiveness of our languages and ability to synthesize code for all 140 specifications is evidence of the feasibility of program synthesis for machine-dependent OS code. However, many research challenges remain; we also discuss the benefits and limitations of our synthesis-based approach to automated OS porting.

computer science, software engineering
Software (Re-)Engineering with PSF II: from architecture to implementation

Bob Diertens

DOI: https://doi.org/10.48550/arXiv.0712.3115

2007-12-19

Abstract:This paper presents ongoing research on the application of PSF in the field of software engineering and reengineering. We build a new implementation for the simulator of the PSF Toolkit starting from the specification in PSF of the architecture of a simple simulator and extend it with features to obtain the architecture of a full simulator. We apply refining and constraining techniques on the specification of the architecture to obtain a specification low enough to build an implementation from.

Software Engineering
Generation of Compiler Backends from Formal Models of Hardware

Gus Henry Smith

2024-08-28

Abstract:Compilers convert between representations -- usually, from higher-level, human writable code to lower-level, machine-readable code. A compiler backend is the portion of the compiler containing optimizations and code generation routines for a specific hardware target. In this dissertation, I advocate for a specific way of building compiler backends: namely, by automatically generating them from explicit, formal models of hardware using automated reasoning algorithms. I describe how automatically generating compilers from formal models of hardware leads to increased optimization ability, stronger correctness guarantees, and reduced development time for compiler backends. As evidence, I present two case studies: first, Glenside, which uses equality saturation to increase the 3LA compiler's ability to offload operations to machine learning accelerators, and second, Lakeroad, a technology mapper for FPGAs which uses program synthesis and semantics extracted from Verilog to map hardware designs to complex, programmable hardware primitives.

Programming Languages,Hardware Architecture
Retargetable Cross Compilation Techniques: Comparison and Analysis of GCC and Zephyr.

Dai Guilan,Tian Jinlan,Zhang Suqing,Jiang Weidu,Dai Jun

DOI: https://doi.org/10.1145/571727.571734

2002-01-01

ACM SIGPLAN Notices

Abstract:Both GCC and Zephyr are representative complier infrastructures. The paper explores the basic questions that need to be resolved to develop compilers for the support of multiple source languages and targets analyses and compares their architectures and key retargetable cross compilation techniques, summarizes the merits and shortcomings, respectively, and draws a conclusion that the Zephyr infrastructure has the advantage over GCC to an extent.
An Open-Source, Industrial-Strength Optimizing Compiler for Quantum Programs

Robert S. Smith,Eric C. Peterson,Mark G. Skilbeck,Erik J. Davis

DOI: https://doi.org/10.48550/arXiv.2003.13961

2020-03-31

Abstract:Quilc is an open-source, optimizing compiler for gate-based quantum programs written in Quil or QASM, two popular quantum programming languages. The compiler was designed with attention toward NISQ-era quantum computers, specifically recognizing that each quantum gate has a non-negligible and often irrecoverable cost toward a program's successful execution. Quilc's primary goal is to make authoring quantum software a simpler exercise by making architectural details less burdensome to the author. Using Quilc allows one to write programs faster while usually not compromising---and indeed sometimes improving---their execution fidelity on a given hardware architecture. In this paper, we describe many of the principles behind Quilc's design, and demonstrate the compiler with various examples.

Quantum Physics,Programming Languages
Concise Read-Only Specifications for Better Synthesis of Programs with Pointers -- Extended Version

Andreea Costea,Amy Zhu,Nadia Polikarpova,Ilya Sergey

DOI: https://doi.org/10.48550/arXiv.2001.10723

2020-01-29

Abstract:In program synthesis there is a well-known trade-off between concise and strong specifications: if a specification is too verbose, it might be harder to write than the program; if it is too weak, the synthesised program might not match the user's intent. In this work we explore the use of annotations for restricting memory access permissions in program synthesis, and show that they can make specifications much stronger while remaining surprisingly concise. Specifically, we enhance Synthetic Separation Logic (SSL), a framework for synthesis of heap-manipulating programs, with the logical mechanism of read-only borrows. We observe that this minimalistic and conservative SSL extension benefits the synthesis in several ways, making it more (a) expressive (stronger correctness guarantees are achieved with a modest annotation overhead), (b) effective (it produces more concise and easier-to-read programs), (c) efficient (faster synthesis), and (d) robust (synthesis efficiency is less affected by the choice of the search heuristic). We explain the intuition and provide formal treatment for read-only borrows. We substantiate the claims (a)--(d) by describing our quantitative evaluation of the borrowing-aware synthesis implementation on a series of standard benchmark specifications for various heap-manipulating programs.

Programming Languages,Logic in Computer Science
TOP: Towards Open & Predictable Heterogeneous SoCs

Luca Valente,Francesco Restuccia,Davide Rossi,Ryan Kastner,Luca Benini

2024-06-07

Abstract:Ensuring predictability in modern real-time Systems-on-Chip (SoCs) is an increasingly critical concern for many application domains such as automotive, robotics, and industrial automation. An effective approach involves the modeling and development of hardware components, such as interconnects and shared memory resources, to evaluate or enforce their deterministic behavior. Unfortunately, these IPs are often closed-source, and these studies are limited to the single modules that must later be integrated with third-party IPs in more complex SoCs, hindering the precision and scope of modeling and compromising the overall predictability. With the coming-of-age of open-source instruction set architectures (RISC-V) and hardware, major opportunities for changing this status quo are emerging. This study introduces an innovative methodology for modeling and analyzing State-of-the-Art (SoA) open-source SoCs for low-power cyber-physical systems. Our approach models and analyzes the entire set of open-source IPs within these SoCs and then provides a comprehensive analysis of the entire architecture. We validate this methodology on a sample heterogenous low-power RISC-V architecture through RTL simulation and FPGA implementation, minimizing pessimism in bounding the service time of transactions crossing the architecture between 28% and 1%, which is considerably lower when compared to similar SoA works.

Hardware Architecture
Compiler backend generation for application specific instruction set processors

Zhen Cao,Yuan Dong,Shengyuan Wang

DOI: https://doi.org/10.1007/978-3-642-25318-8_12

2011-01-01

Abstract:Application Specific Instruction Set Processors (ASIPs) have become popular in the development of embedded systems. For these processors easily-retargetable, high-performance compilers play a key role in the development process, improving productivity and reducing time-to-market. We propose a novel, object-based architecture description language (ADL) OpenDL, as well as a well-structured Rule Library to automatically retarget compiler backends. OpenDL is a succinct and high-quality ADL with object-based inheritance features, while the Rule Library applies instruction templating in order to allow detailed instruction specification to handle complex rule patterns. We use these tools to automatically retarget the open source industrial-strength compiler Open64 to the high-performance embedded processor PowerPC. A reliable version of auto-retargetable industrial-strength compiler is generated which achieves comparable performance to gcc 4.5 for both the EEMBC and SPEC CPU 2000 benchmarks.
Research on Open Source Processor and Analysis of Current Development Dilemma Based on RISC-V.

Tianchen He,Xiangning Chen,Guokang Wang

DOI: https://doi.org/10.1109/ICCCS57501.2023.10151171

2023-01-01

Abstract:ISA (instruction set architecture) is a bridge and interface between the underlying hardware of the processor and the software running on it. It is also an important abstraction layer in the computer processor. With ISA, different processor hardware implementations can be used to design processors with different performance. RISC-V is the interface specification between software and hardware, which is also the origin point of an information technology ecosystem. RISC-V is the inevitable product of computer architecture gradually moving towards openness. It brings a new paradigm for system research, i.e. software research issues can be tracked down to ISA, which expands or even subverts the traditional full-stack design theory on the system function, performance, security and other issues, showing a promising development prospect. In this paper, RISC-V is introduced in detail, including Instruction Length Encoding, instruction set, general register set, encoding format and privilege mode, etc. Several open-source processors using RISC-V architecture are introduced, and the current difficulties and breakthroughs of RISC-V are analyzed. Finally, the future development of RISC-V is prospected.
Design and architecture of the IBM Quantum Engine Compiler

Michael B. Healy,Reza Jokar,Soolu Thomas,Vincent R. Pascuzzi,Kit Barton,Thomas A. Alexander,Roy Elkabetz,Brian C. Donovan,Hiroshi Horii,Marius Hillenbrand

2024-08-13

Abstract:In this work, we describe the design and architecture of the open-source Quantum Engine Compiler (qe-compiler) currently used in production for IBM Quantum systems. The qe-compiler is built using LLVM's Multi-Level Intermediate Representation (MLIR) framework and includes definitions for several dialects to represent parameterized quantum computation at multiple levels of abstraction. The compiler also provides Python bindings and a diagnostic system. An open-source LALR lexer and parser built using Bison and Flex generates an Abstract Syntax Tree that is translated to a high-level MLIR dialect. An extensible hierarchical target system for modeling the heterogeneous nature of control systems at compilation time is included. Target-based and generic compilation passes are added using a pipeline interface to translate the input down to low-level intermediate representations (including LLVM IR) and can take advantage of LLVM backends and tooling to generate machine executable binaries. The qe-compiler is built to be extensible, maintainable, performant, and scalable to support the future of quantum computing.

Quantum Physics,Emerging Technologies
Do You Even Lift? Strengthening Compiler Security Guarantees Against Spectre Attacks

Xaver Fabian,Marco Patrignani,Marco Guarnieri,Michael Backes

2024-05-16

Abstract:Mainstream compilers implement different countermeasures to prevent specific classes of speculative execution attacks. Unfortunately, these countermeasures either lack formal guarantees or come with proofs restricted to speculative semantics capturing only a subset of the speculation mechanisms supported by modern CPUs, thereby limiting their practical applicability. Ideally, these security proofs should target a speculative semantics capturing the effects of all speculation mechanisms implemented in modern CPUs. However, this is impractical and requires new secure compilation proofs to support additional speculation mechanisms. In this paper, we address this problem by proposing a novel secure compilation framework that allows lifting the security guarantees provided by Spectre countermeasures from weaker speculative semantics (ignoring some speculation mechanisms) to stronger ones (accounting for the omitted mechanisms) without requiring new secure compilation proofs. Using our lifting framework, we performed the most comprehensive security analysis of Spectre countermeasures implemented in mainstream compilers to date. Our analysis spans 9 different countermeasures against 5 classes of Spectre attacks, which we proved secure against a speculative semantics accounting for five different speculation mechanisms.

Programming Languages
BRISC-V: An Open-Source Architecture Design Space Exploration Toolbox

Sahan Bandara,Alan Ehret,Donato Kava,Michel A. Kinsy

DOI: https://doi.org/10.1145/3289602.3293991

2019-08-27

Abstract:In this work, we introduce a platform for register-transfer level (RTL) architecture design space exploration. The platform is an open-source, parameterized, synthesizable set of RTL modules for designing RISC-V based single and multi-core architecture systems. The platform is designed with a high degree of modularity. It provides highly-parameterized, composable RTL modules for fast and accurate exploration of different RISC-V based core complexities, multi-level caching and memory organizations, system topologies, router architectures, and routing schemes. The platform can be used for both RTL simulation and FPGA based emulation. The hardware modules are implemented in synthesizable Verilog using no vendor-specific blocks. The platform includes a RISC-V compiler toolchain to assist in developing software for the cores, a web-based system configuration graphical user interface (GUI) and a web-based RISC-V assembly simulator. The platform supports a myriad of RISC-V architectures, ranging from a simple single cycle processor to a multi-core SoC with a complex memory hierarchy and a network-on-chip. The modules are designed to support incremental additions and modifications. The interfaces between components are particularly designed to allow parts of the processor such as whole cache modules, cores or individual pipeline stages, to be modified or replaced without impacting the rest of the system. The platform allows researchers to quickly instantiate complete working RISC-V multi-core systems with synthesizable RTL and make targeted modifications to fit their needs. The complete platform (including Verilog source code) can be downloaded at <a class="link-external link-https" href="https://ascslab.org/research/briscv/explorer/explorer.html" rel="external noopener nofollow">this https URL</a>.

Hardware Architecture
Retargetable Cross Compilation Techniques

Dai Guilan,Tian Jinlan,Zhang Suqin,Jiang Weidu,Dai Jun

DOI: https://doi.org/10.1145/571727.571734

2002-01-01

ACM SIGPLAN Notices

Abstract:Both GCC and Zephyr are representative complier infrastructures. The paper explores the basic questions that need to be resolved to develop compilers for the support of multiple source languages and targets analyses and compares their architectures and key retargetable cross compilation techniques, summarizes the merits and shortcomings, respectively, and draws a conclusion that the Zephyr infrastructure has the advantage over GCC to an extent.

Research Note: An Open Source Bluespec Compiler

The essence of Bluespec: a core language for rule-based hardware design

SpecTest: Specification-Based Compiler Testing

Toward an Open-Source Digital Flow

Preprint: Open Source Compiling for V1Model RMT Switch: Making Data Center Networking Innovation Accessible

Defining Name Accessibility using Scope Graphs (Extended Edition)

Research on Open-Source Hardware Based Design Method

An open-source P4 16 compiler backend for reconfigurable match-action table switches: Making networking innovation accessible

Towards Porting Operating Systems with Program Synthesis

Software (Re-)Engineering with PSF II: from architecture to implementation

Generation of Compiler Backends from Formal Models of Hardware

Retargetable Cross Compilation Techniques: Comparison and Analysis of GCC and Zephyr.

An Open-Source, Industrial-Strength Optimizing Compiler for Quantum Programs

Concise Read-Only Specifications for Better Synthesis of Programs with Pointers -- Extended Version

TOP: Towards Open & Predictable Heterogeneous SoCs

Compiler backend generation for application specific instruction set processors

Research on Open Source Processor and Analysis of Current Development Dilemma Based on RISC-V.

Design and architecture of the IBM Quantum Engine Compiler

Do You Even Lift? Strengthening Compiler Security Guarantees Against Spectre Attacks

BRISC-V: An Open-Source Architecture Design Space Exploration Toolbox

Retargetable Cross Compilation Techniques