Abstract:There is unprecedented development in machine learning, exemplified by recent large language models and world simulators, which are artificial neural networks running on digital computers. However, they still cannot parallel human brains in terms of energy efficiency and the streamlined adaptability to inputs of different difficulties, due to differences in signal representation, optimization, run-time reconfigurability, and hardware architecture. To address these fundamental challenges, we introduce pruning optimization for input-aware dynamic memristive spiking neural network (PRIME). Signal representation-wise, PRIME employs leaky integrate-and-fire neurons to emulate the brain's inherent spiking mechanism. Drawing inspiration from the brain's structural plasticity, PRIME optimizes the topology of a random memristive spiking neural network without expensive memristor conductance fine-tuning. For runtime reconfigurability, inspired by the brain's dynamic adjustment of computational depth, PRIME employs an input-aware dynamic early stop policy to minimize latency during inference, thereby boosting energy efficiency without compromising performance. Architecture-wise, PRIME leverages memristive in-memory computing, mirroring the brain and mitigating the von Neumann bottleneck. We validated our system using a 40 nm 256 Kb memristor-based in-memory computing macro on neuromorphic image classification and image inpainting. Our results demonstrate the classification accuracy and Inception Score are comparable to the software baseline, while achieving maximal 62.50-fold improvements in energy efficiency, and maximal 77.0% computational load savings. The system also exhibits robustness against stochastic synaptic noise of analogue memristors. Our software-hardware co-designed model paves the way to future brain-inspired neuromorphic computing with brain-like energy efficiency and adaptivity.

Power-efficient combinatorial optimization using intrinsic noise in memristor Hopfield neural networks

Harnessing Intrinsic Noise in Memristor Hopfield Neural Networks for Combinatorial Optimization

Simulated Annealing Based on Memristors for Efficient Solution of Optimization Problems

Transiently chaotic simulated annealing based on intrinsic nonlinearity of memristors for efficient solution of optimization problems.

Combinatorial optimization by weight annealing in memristive hopfield networks

Noise tailoring, noise annealing and external noise injection strategies in memristive Hopfield neural networks

Memristor-based hardware and algorithms for higher-order Hopfield optimization solver outperforming quadratic Ising machines

Stochastic neuro-fuzzy system implemented in memristor crossbar arrays

Energy Efficient Knapsack Optimization Using Probabilistic Memristor Crossbars

Heterostimuli chemo-modulation of neuromorphic nanocomposites for time-, power-, and data-efficient machine learning

Topology Optimization of Random Memristors for Input-Aware Dynamic SNN

Energy Efficient Memristive Transiently Chaotic Neural Network for Combinatorial Optimization

Optogenetics Inspired Transition Metal Dichalcogenide Neuristors for In-Memory Deep Recurrent Neural Networks

Optically Modulated Dual‐mode Memristor Arrays Based on Core‐shell CsPbBr3@graphdiyne Nanocrystals for Fully Memristive Neuromorphic Computing Hardware

Synergistic Development of Perovskite Memristors and Algorithms for Robust Analog Computing

Leveraging Tunability of Localized-Interfacial Memristors for Efficient Handling of Complex Neural Networks

A Compute-in-Memory Annealing Processor With Interaction Coefficient Reuse and Sparse Energy Computation for Solving Combinatorial Optimization Problems

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

Neuromorphic Devices and Networks Based on Memristors with Ionic Dynamics

CMOS Back-End Compatible Memristors for in Situ Digital and Neuromorphic Computing Applications.