Abstract:In recent years, there has been a significant advancement in memristor-based neural networks, positioning them as a pivotal processing-in-memory deployment architecture for a wide array of deep learning applications. Within this realm of progress, the emerging parallel analog memristive platforms are prominent for their ability to generate multiple feature maps in a single processing cycle. However, a notable limitation is that they are specifically tailored for neural networks with fixed structures. As an orthogonal direction, recent research reveals that neural architecture should be specialized for tasks and deployment platforms. Building upon this, the neural architecture search (NAS) methods effectively explore promising architectures in a large design space. However, these NAS-based architectures are generally heterogeneous and diversified, making it challenging for deployment on current single-prototype, customized, parallel analog memristive hardware circuits. Therefore, investigating memristive analog deployment that overrides the full search space is a promising and challenging problem. Inspired by this, and beginning with the DARTS search space, we study the memristive hardware design of primitive operations and propose the memristive all-inclusive hypernetwork that covers 2×1025 network architectures. Our computational simulation results on 3 representative architectures (DARTS-V1, DARTS-V2, PDARTS) show that our memristive all-inclusive hypernetwork achieves promising results on the CIFAR10 dataset (89.2% of PDARTS with 8-bit quantization precision), and is compatible with all architectures in the DARTS full-space. The hardware performance simulation indicates that the memristive all-inclusive hypernetwork costs slightly more resource consumption (nearly the same in power, 22%∼25% increase in Latency, 1.5× in Area) relative to the individual deployment, which is reasonable and may reach a tolerable trade-off deployment scheme for industrial scenarios.

Energy Efficient Memristive Transiently Chaotic Neural Network for Combinatorial Optimization

A memristor-based transient chaotic neural network model and its application

A Ferroelectric Memristor-Based Transient Chaotic Neural Network for Solving Combinatorial Optimization Problems

Transiently chaotic simulated annealing based on intrinsic nonlinearity of memristors for efficient solution of optimization problems.

Simulated Annealing Based on Memristors for Efficient Solution of Optimization Problems

Harnessing Intrinsic Noise in Memristor Hopfield Neural Networks for Combinatorial Optimization

Improved Algorithm of Transient Chaotic Neural Network with Combinatorial Optimization

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

Topology Optimization of Random Memristors for Input-Aware Dynamic SNN

A novel fractional-order memristive Hopfield neural network for traveling salesman problem and its FPGA implementation

A Memristive Neural Network Computing Engine using CMOS-Compatible Charge-Trap-Transistor (CTT).

A Memristive Neural Network Based Matrix Equation Solver with High Versatility and High Energy Efficiency

A memristive all-inclusive hypernetwork for parallel analog deployment of full search space architectures

Energy Consumption Analysis for Various Memristive Networks under Different Learning Strategies

Memristor Neural Network Design

Power-efficient combinatorial optimization using intrinsic noise in memristor Hopfield neural networks

Memristor-based Chaotic Neural Networks for Associative Memory

A Neuromorphic Design Using Chaotic Mott Memristor with Relaxation Oscillation.

Full-Circuit Implementation of Transformer Network Based on Memristor

In-memory sparse matrix multiplication with a low-power self-rectifying memristor array

A Closed-Loop Design to Enhance Weight Stability of Memristor Based Neural Network Chips