Abstract:Specialized function gradient computing hardware could greatly improve the performance of state-of-the-art optimization algorithms, e.g., based on gradient descent or conjugate gradient methods that are at the core of control, machine learning, and operations research applications. Prior work on such hardware, performed in the context of the Ising Machines and related concepts, is limited to quadratic polynomials and not scalable to commonly used higher-order functions. Here, we propose a novel approach for massively parallel gradient calculations of high-degree polynomials, which is conducive to efficient mixed-signal in-memory computing circuit implementations and whose area complexity scales linearly with the number of variables and terms in the function and, most importantly, independent of its degree. Two flavors of such an approach are proposed. The first is limited to binary-variable polynomials typical in combinatorial optimization problems, while the second type is broader at the cost of a more complex periphery. To validate the former approach, we experimentally demonstrated solving a small-scale third-order Boolean satisfiability problem based on integrated metal-oxide memristor crossbar circuits, one of the most prospective in-memory computing device technologies, with a competitive heuristics algorithm. Simulation results for larger-scale, more practical problems show orders of magnitude improvements in the area, and related advantages in speed and energy efficiency compared to the state-of-the-art. We discuss how our work could enable even higher-performance systems after co-designing algorithms to exploit massively parallel gradient computation.

SAGA: Synthesis Augmentation with Genetic Algorithms for In-Memory Sequence Optimization

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

A Genetic Algorithm Accelerator Based on Memristive Crossbar Array for Massively Parallel Computation

Data Allocation for Hybrid Memory with Genetic Algorithm

14.2 A Compute SRAM with Bit-Serial Integer/Floating-Point Operations for Programmable In-Memory Vector Acceleration

IMCS2: Novel Device-to-Architecture Co-Design for Low-Power In-Memory Computing Platform Using Coterminous Spin Switch

Should We Even Optimize for Execution Energy? Rethinking Mapping for MAGIC Design Style

Parallel programming of an ionic floating-gate memory array for scalable neuromorphic computing

Graph Algorithm Optimization for Spintronics-based In-memory Computing Architecture

Saturn: Sample-efficient Generative Molecular Design using Memory Manipulation

Computing High-Degree Polynomial Gradients in Memory

In-memory Computing with Emerging Nonvolatile Memory Devices

Improving Efficiency and Lifetime of Logic-in-Memory by Combining IMPLY and MAGIC Families

Low Power In-Memory Computing Based On Dual-Mode Sot-Mram

AIM: Annealing in Memory for Vision Applications.

Phase-Change Memory Optimization for Green Cloud with Genetic Algorithm

HIPE-MAGIC: A Technology-Aware Synthesis and Mapping Flow for HIghly Parallel Execution of Memristor-Aided LoGIC

MeG<SUP>2</SUP>: In-Memory Acceleration for Genome Graphs Analysis

Probabilistic Compute-in-Memory Design For Efficient Markov Chain Monte Carlo Sampling

High performance and energy-efficient in-memory computing architecture based on SOT-MRAM

IMGA: Efficient In-Memory Graph Convolution Network Aggregation with Data Flow Optimizations