Abstract:The exponential emergence of Field Programmable Gate Array (FPGA) has accelerated the research of hardware implementation of Deep Neural Network (DNN). Among all DNN processors, domain specific architectures, such as, Google's Tensor Processor Unit (TPU) have outperformed conventional GPUs. However, implementation of TPUs in reconfigurable hardware should emphasize energy savings to serve the green computing requirement. Voltage scaling, a popular approach towards energy savings, can be a bit critical in FPGA as it may cause timing failure if not done in an appropriate way. In this work, we present an ultra low power FPGA implementation of a TPU for edge applications. We divide the systolic-array of a TPU into different FPGA partitions, where each partition uses different near threshold (NTC) biasing voltages to run its FPGA cores. The biasing voltage for each partition is roughly calculated by the proposed static schemes. However, further calibration of biasing voltage is done by the proposed runtime scheme. Four clustering algorithms based on the minimum slack value of different design paths of Multiply Accumulates (MACs) study the partitioning of FPGA. To overcome the timing failure caused by NTC, the MACs which have higher minimum slack are placed in lower voltage partitions and the MACs have lower minimum slack path are placed in higher voltage partitions. The proposed architecture is simulated in a commercial platform : Vivado with Xilinx Artix-7 FPGA and academic platform VTR with 22nm, 45nm, 130nm FPGAs. The simulation results substantiate the implementation of voltage scaled TPU in FPGAs and also justifies its power efficiency.

Dynamic Voltage and Frequency Scaling Architecture for Units Integration within a GALS NoC

Power Reduction Through Measurement and Modeling of Users and CPUs: Summary

User- and Process-Driven Dynamic Voltage and Frequency Scaling.

Noise-Aware DVFS for Efficient Transitions on Battery-Powered IoT Devices

Noise-aware DVFS Transition Sequence Optimization for Battery-Powered IoT Devices.

A novel cross-layer framework for early-stage power delivery and architecture co-exploration.

User-Driven Frequency Scaling

Dynamic voltage and frequency scaling circuits with two supply voltages

Dynamic Voltage and Frequency Scaling for Intermittent Computing

Dynamic Power Management for Neuromorphic Many-Core Systems

A Reliable and Efficient Online Solution for Adaptive Voltage and Frequency Scaling on FPGAs

A System-Level Voltage/Frequency Scaling Characterization Framework for Multicore CPUs

A power-aware system combining static compiling and DVFS

High Performance, Energy Efficiency, and Scalability with Gals Chip Multiprocessors

Voltage island-driven power optimization for application specific network-on-chip design.

Towards Power Efficient DNN Accelerator Design on Reconfigurable Platform

Learning-Directed Dynamic Voltage and Frequency Scaling Scheme with Adjustable Performance for Single-Core and Multi-Core Embedded and Mobile Systems

Dynamic Voltage Scaling with Links for Power Optimization of Interconnection Networks

Dynamic Voltage and Frequency Scaling as a Method for Reducing Energy Consumption in Ultra-Low-Power Embedded Systems

A Single-Vdd Half-Clock-tolerant Fine-Grained Dynamic Voltage Scaling Pipeline.

Dynamic voltage and frequency scaling based on workload decomposition