Abstract:The increasing complexity of deep learning systems has pushed conventional computing technologies to their limits. While the memristor is one of the prevailing technologies for deep learning acceleration, it is only suited for classical learning layers where only two operands, namely weights and inputs, are processed simultaneously. Meanwhile, to improve the computational efficiency of deep learning for emerging applications, a variety of non-traditional layers requiring concurrent processing of many operands are becoming popular. For example, hypernetworks improve their predictive robustness by simultaneously processing weights and inputs against the application context. Two-electrode memristor grids cannot directly map emerging layers’ higher-order multiplicative neural interactions. Addressing this unmet need, we present crossbar processing using dual-gated memtransistors based on two-dimensional semiconductor MoS 2 . Unlike the memristor, the resistance states of memtransistors can be persistently programmed and can be actively controlled by multiple gate electrodes. Thus, the discussed memtransistor crossbar enables several advanced inference architectures beyond a conventional passive crossbar. For example, we show that sneak paths can be effectively suppressed in memtransistor crossbars, whereas they limit size scalability in a passive memristor crossbar. Similarly, exploiting gate terminals to suppress crossbar weights dynamically reduces biasing power by ∼20% in memtransistor crossbars for a fully connected layer of AlexNet. On emerging layers such as hypernetworks, collocating multiple operations within the same crossbar cells reduces operating power by ∼ 15 × on the considered network cases.

Binary Weighted Memristive Analog Deep Neural Network for Near-Sensor Edge Processing

Aging Aware Retraining for Memristor-based Neuromorphic Computing

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

Advancing Memristive Analog Neuromorphic Networks: Increasing Complexity, and Coping with Imperfect Hardware Components

Improving energy efficiency and classification accuracy of neuromorphic chips by learning binary synaptic crossbars

Memristor crossbar deep network implementation based on a Convolutional neural network

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy

Threshold learning algorithm for memristive neural network with binary switching behavior

A Hardware Neural Network for Handwritten Digits Recognition Using Binary RRAM As Synaptic Weight Element

Pulse-Width Modulation Based Dot-Product Engine For Neuromorphic Computing System Using Memristor Crossbar Array

Binary Neural Network with 16 Mb Rram Macro Chip for Classification and Online Training

Higher order neural processing with input-adaptive dynamic weights on MoS2 memtransistor crossbars

Implementation of Convolutional Neural Networks in Memristor Crossbar Arrays with Binary Activation and Weight Quantization

A Memristor Crossbar Based Computing Engine Optimized for High Speed and Accuracy

Analogue Signal and Image Processing with Large Memristor Crossbars

Quantization of Deep Neural Networks to facilitate self-correction of weights on Phase Change Memory-based analog hardware

Deep Learning in Memristive Nanowire Networks

In Situ Training of Feed-Forward and Recurrent Convolutional Memristor Networks

Hybrid architecture based on two-dimensional memristor crossbar array and CMOS integrated circuit for edge computing

Mem-elements based Neuromorphic Hardware for Neural Network Application