Abstract:In recent years, there has been a significant advancement in memristor-based neural networks, positioning them as a pivotal processing-in-memory deployment architecture for a wide array of deep learning applications. Within this realm of progress, the emerging parallel analog memristive platforms are prominent for their ability to generate multiple feature maps in a single processing cycle. However, a notable limitation is that they are specifically tailored for neural networks with fixed structures. As an orthogonal direction, recent research reveals that neural architecture should be specialized for tasks and deployment platforms. Building upon this, the neural architecture search (NAS) methods effectively explore promising architectures in a large design space. However, these NAS-based architectures are generally heterogeneous and diversified, making it challenging for deployment on current single-prototype, customized, parallel analog memristive hardware circuits. Therefore, investigating memristive analog deployment that overrides the full search space is a promising and challenging problem. Inspired by this, and beginning with the DARTS search space, we study the memristive hardware design of primitive operations and propose the memristive all-inclusive hypernetwork that covers 2×1025 network architectures. Our computational simulation results on 3 representative architectures (DARTS-V1, DARTS-V2, PDARTS) show that our memristive all-inclusive hypernetwork achieves promising results on the CIFAR10 dataset (89.2% of PDARTS with 8-bit quantization precision), and is compatible with all architectures in the DARTS full-space. The hardware performance simulation indicates that the memristive all-inclusive hypernetwork costs slightly more resource consumption (nearly the same in power, 22%∼25% increase in Latency, 1.5× in Area) relative to the individual deployment, which is reasonable and may reach a tolerable trade-off deployment scheme for industrial scenarios.

Analog Alchemy: Neural Computation with In-Memory Inference, Learning and Routing

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Neuromorphic Computing Systems with Emerging Nonvolatile Memories: A Circuits and Systems Perspective

Memristive Devices and Networks for Brain‐Inspired Computing

Memristors -- from In-memory computing, Deep Learning Acceleration, Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired Computing

An overview memristor based hardware accelerators for deep neural network

Memristor-based Energy-Efficient Neuromorphic Computing

Building Neuromorphic Circuits with Memristive Devices

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

Memristor-based Neuromorphic Implementations for Artificial Neural Networks

Hardware implementation of memristor-based artificial neural networks

Memristors—From In‐Memory Computing, Deep Learning Acceleration, and Spiking Neural Networks to the Future of Neuromorphic and Bio‐Inspired Computing

An Overview On Memristor Crossabr Based Neuromorphic Circuit And Architecture

Cortical Processing with Thermodynamic-RAM

Integration and Co-design of Memristive Devices and Algorithms for Artificial Intelligence

Emerging Memory Devices for Neuromorphic Computing

Topology Optimization of Random Memristors for Input-Aware Dynamic SNN

Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Network

A memristive all-inclusive hypernetwork for parallel analog deployment of full search space architectures

Optogenetics Inspired Transition Metal Dichalcogenide Neuristors for In-Memory Deep Recurrent Neural Networks

A Brain-Plausible Neuromorphic On-the-fly Learning System Implemented with Magnetic Domain Wall Analog Memristors