Abstract:Neuromorphic hardware platforms can significantly lower the energy overhead of a machine learning inference task. We present a design-technology tradeoff analysis to implement such inference tasks on the processing elements (PEs) of a Non- Volatile Memory (NVM)-based neuromorphic hardware. Through detailed circuit-level simulations at scaled process technology nodes, we show the negative impact of technology scaling on the information-processing latency, which impacts the quality-of-service (QoS) of an embedded ML system. At a finer granularity, the latency inside a PE depends on 1) the delay introduced by parasitic components on its current paths, and 2) the varying delay to sense different resistance states of its NVM cells. Based on these two observations, we make the following three contributions. First, on the technology front, we propose an optimization scheme where the NVM resistance state that takes the longest time to sense is set on current paths having the least delay, and vice versa, reducing the average PE latency, which improves the QoS. Second, on the architecture front, we introduce isolation transistors within each PE to partition it into regions that can be individually power-gated, reducing both latency and energy. Finally, on the system-software front, we propose a mechanism to leverage the proposed technological and architectural enhancements when implementing a machine-learning inference task on neuromorphic PEs of the hardware. Evaluations with a recent neuromorphic hardware architecture show that our proposed design-technology co-optimization approach improves both performance and energy efficiency of machine-learning inference tasks without incurring high cost-per-bit.

Impacts of Parasitic Effects on PCM-based Neuromorphic Circuits Under Advanced Technology Nodes

Electromagentic Impact of Parasitic Effects on the STDP Characteristics in Neuromorphic Memristor Crossbar Arrays

Critical Parasitic Capacitance in Nano-Scale Phase-Change Memory (PCM) Cell

Analyzing the Influence of Parasitic Effects on Memristor STDP with the PEEC Method

The Impact of Emerging Technologies on Architectures and System-level Management: Invited Paper.

Parasitic Capacitance Effect on Programming Performance of Phase Change Random Access Memory Devices

Modeling and Signal Integrity Analysis of RRAM-Based Neuromorphic Chip Crossbar Array Using Partial Equivalent Element Circuit (PEEC) Method

Impact of the Interconnection Structure on RRAM-Based Crossbar Array in Neuromorphic Chip

Modeling and Test for Parasitic Resistance and Capacitance Defects in PCM

An NEGF-Based Comprehensive Analysis of Parasitic Effects in Stacked Nanosheet FETs at 1.5-Nm Technology Node

Modeling and Analysis of a Large-Scale Memristor Crossbar Array for Neuromorphic Chip

Physical aspects of low power synapses based on phase change memory devices

A SPICE Model of Phase Change Memory for Neuromorphic Circuits

Compact Modeling and Mitigation of Parasitics in Crosspoint Accelerators of Neural Networks

A review of compact modeling for phase change memory

Field-Based Parasitic Capacitance Models for 2d and 3d Sub-45-Nm Interconnect

Design-Technology Co-Optimization for NVM-based Neuromorphic Processing Elements

Exploiting nanoscale effects in phase change memories

Design Technology Co-Optimization for Neuromorphic Computing

Achieving High Core Neuron Density in a Neuromorphic Chip Through Trade-off Among Area, Power Consumption, and Data Access Bandwidth

ON-CHIP INTERCONNECT SIMULATION OF PARASITIC CAPACITANCES IN PERIODIC STRUCTURES