Abstract:Remarkable breakthroughs but daunting complexities of deep learning have aroused widespread interest in dedicated deep neural network (DNN) acceleration hardware, among which optical accelerators (OAs) are particularly promising thanks to their unprecedentedly high-performance-per-watt. However, the development of OAs is much slower than that of electrical accelerators due to threefold challenges. First, the OA design space is ample and discrete, making it tough for OA optimization; Second, the ecosystem that facilitates OA development is still in its infancy. Techniques to support OA design remain less explored, limiting both the achievable performance and the innovative development of OAs; and Third, OAs are highly sensitive to fabrication-induced process variations and thermal fluctuations (i.e., PTVs), which degrades OAs’ inference robustness and even renders them unusable in practice. In this article, we develop AutOAS, the first-of-its-kind framework for Automated Optical Accelerator Search, in order to jointly boost acceleration efficiency, inference robustness, and development speed. Our AutOAS comprises four enabling components: 1) a holistic OA search space, which takes full consideration of OAs’ micro-architectures (e.g., the type, shape and size of core functional units for data computation and data access), dataflow choices, DNN-to-accelerator mapping methods, memory hierarchy and PTV mitigation techniques; 2) a PTV Regulator, which can emulate the impact of PTVs on OAs’ inference accuracy based on given PTV profiles, and enables energy-efficient PTV mitigation on OAs; 3) an O-Performance Predictor, which enables accurate yet efficient predictions of an OA’s energy, throughput (latency) and chip area according to the DNN model and OA architecture parameters; and 4) two O-Search Engines (i.e., a differentiable search engine and an evolutionary search engine), which can automatically explore the large design space of OAs and identify the optimal accelerators to maximize the acceleration targets. Based on 10 DNN models widely applied in both computer vision and sequence modeling tasks, extensive experiments and ablation studies validate the effectiveness of our PTV Regulator, O-Performance Predictor, and O-Search Engines, as well as the superior performance of AutOAS-generated OAs.

Efficient and Fast High-performance Library Generation for Deep Learning Accelerators

Heron: Automatically Constrained High-Performance Library Generation for Deep Learning Accelerators

Woodpecker-DL: Accelerating Deep Neural Networks via Hardware-Aware Multifaceted Optimizations

Survey and design of paleozoic: a high-performance compiler tool chain for deep learning inference accelerator

Bring Your Own Codegen to Deep Learning Compiler

HybridDNN: A Framework for High-Performance Hybrid DNN Accelerator Design and Implementation.

Automatic Generation of Fast and Accurate Performance Models for Deep Neural Network Accelerators

Being-ahead: Benchmarking and Exploring Accelerators for Hardware-Efficient AI Deployment

Software-defined Design Space Exploration for an Efficient DNN Accelerator Architecture

Ansor: Generating {High-Performance} tensor programs for deep learning

Ansor : Generating High-Performance Tensor Programs for Deep Learning

O-HAS: Optical Hardware Accelerator Search for Boosting Both Acceleration Performance and Development Speed

Polymorphic Accelerators for Deep Neural Networks

FlexPDA: A Flexible Programming Framework for Deep Learning Accelerators.

Model-Platform Optimized Deep Neural Network Accelerator Generation Through Mixed-Integer Geometric Programming.

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip

LHC: A Low-Power Heterogeneous Computing Method on Neural Network Accelerator

DGNN-Booster: A Generic FPGA Accelerator Framework For Dynamic Graph Neural Network Inference

Automated Optical Accelerator Search Toward Superior Acceleration Efficiency, Inference Robustness, and Development Speed

Automatic Generation of Spatial Accelerator for Tensor Algebra

Polaris: Multi-Fidelity Design Space Exploration of Deep Learning Accelerators