Abstract:There is unprecedented development in machine learning, exemplified by recent large language models and world simulators, which are artificial neural networks running on digital computers. However, they still cannot parallel human brains in terms of energy efficiency and the streamlined adaptability to inputs of different difficulties, due to differences in signal representation, optimization, run-time reconfigurability, and hardware architecture. To address these fundamental challenges, we introduce pruning optimization for input-aware dynamic memristive spiking neural network (PRIME). Signal representation-wise, PRIME employs leaky integrate-and-fire neurons to emulate the brain's inherent spiking mechanism. Drawing inspiration from the brain's structural plasticity, PRIME optimizes the topology of a random memristive spiking neural network without expensive memristor conductance fine-tuning. For runtime reconfigurability, inspired by the brain's dynamic adjustment of computational depth, PRIME employs an input-aware dynamic early stop policy to minimize latency during inference, thereby boosting energy efficiency without compromising performance. Architecture-wise, PRIME leverages memristive in-memory computing, mirroring the brain and mitigating the von Neumann bottleneck. We validated our system using a 40 nm 256 Kb memristor-based in-memory computing macro on neuromorphic image classification and image inpainting. Our results demonstrate the classification accuracy and Inception Score are comparable to the software baseline, while achieving maximal 62.50-fold improvements in energy efficiency, and maximal 77.0% computational load savings. The system also exhibits robustness against stochastic synaptic noise of analogue memristors. Our software-hardware co-designed model paves the way to future brain-inspired neuromorphic computing with brain-like energy efficiency and adaptivity.

Cryogenic in-memory computing using tunable chiral edge states

Memristors with Tunable Characteristics Based on the Tellurene/nb-Doped MoS2 Heterojunction Toward Bio-Realistic Synaptic Emulation

CryoCiM: Cryogenic compute-in-memory based on the quantum anomalous Hall effect

Energy-Efficient, Stable and Temperature-Tolerant Neuromorphic Device Based on Single Crystals of Halide Perovskites

Selective and quasi-continuous switching of ferroelectric Chern insulator devices for neuromorphic computing

Cryogenic Materials and Circuit Integration for Quantum Computers

A non-volatile cryogenic random-access memory based on the quantum anomalous Hall effect

Energy efficient manipulation of topologically protected states in non-volatile ultrafast charge configuration memory devices

Cryogenic Control and Readout Integrated Circuits for Solid-State Quantum Computing

Cryogenic quasi-static embedded DRAM for energy-efficient compute-in-memory applications

Selective and Quasi-continuous Switching of Ferroelectric Chern Insulator Device for Neuromorphic Computing

A Cryogenic Memristive Neural Decoder for Fault-tolerant Quantum Error Correction

Cryogenic CMOS RF Circuits: A Promising Approach for Large-Scale Quantum Computing

An in-memory computing architecture based on a duplex two-dimensional material structure for in situ machine learning

Cryogenic Characerization and Modeling of Standard CMOS down to Liquid Helium Temperature for Quantum Computing

Cryogenic Control Architecture for Large-Scale Quantum Computing

Research Progress on the Application of Topological Phase Transition Materials in the Field of Memristor and Neuromorphic Computing

Parallel refreshed cryogenic charge-locking array with low power dissipation

Cryogenic Memory Technologies

On-chip cryogenic multiplexing of Si/SiGe quantum devices

Topology Optimization of Random Memristors for Input-Aware Dynamic SNN