Abstract:Operations on high-dimensional, fixed-width vectors can be used to distribute information from several vectors over a single vector of the same width. For example, a set of key-value pairs can be encoded into a single vector with multiplication and addition of the corresponding key and value vectors: the keys are bound to their values with component-wise multiplication, and the key-value pairs are combined into a single superposition vector with component-wise addition. The superposition vector is, thus, a memory which can then be queried for the value of any of the keys, but the result of the query is approximate. The exact vector is retrieved from a codebook (a.k.a. item memory), which contains vectors defined in the system. To perform these operations, the item memory vectors and the superposition vector must be the same width. Increasing the capacity of the memory requires increasing the width of the superposition and item memory vectors. In this article, we demonstrate that in a regime where many (e.g., 1,000 or more) key-value pairs are stored, an associative memory which maps key vectors to value vectors requires less memory and less computing to obtain the same reliability of storage as a superposition vector. These advantages are obtained because the number of storage locations in an associate memory can be increased without increasing the width of the vectors in the item memory. An associative memory would not replace a superposition vector as a medium of storage, but could augment it, because data recalled from an associative memory could be used in algorithms that use a superposition vector. This would be analogous to how human working memory (which stores about seven items) uses information recalled from long-term memory (which is much larger than the working memory). We demonstrate the advantages of an associative memory experimentally using the storage of large finite-state automata, which could model the storage and recall of state-dependent behavior by brains.

Predecessor on the Ultra-Wide Word RAM

Dynamic Range Minimum Queries on the Ultra-Wide Word RAM

Algorithms in the Ultra-Wide Word Model

Ultrafast Self-Rectifying Memristors for Advanced In-Memory Computing

On separating long- and short-term memories in hyperdimensional computing

Minimal Indices for Successor Search

Bi-Directional and Operand-Controllable In-Memory Computing for Boolean Logic and Search Operations with Row and Column Directional SRAM (RC-SRAM)

Parallel-Prefix Adder in Spin-Orbit Torque Magnetic RAM for High Bit-Width Non-Volatile Computation

TCAD Simulation Studies on Ultra-Low-Power Non-Volatile Memory

3D-Swift: A High-Performance 3D-Stacked Wide Io Dram

Computing the BWT and LCP array of a Set of Strings in External Memory

A Note on the Longest Common Compatible Prefix Problem for Partial Words

WideSA: A High Array Utilization Mapping Scheme for Uniform Recurrences on ACAP

Crossbar-Constrained Technology Mapping for ReRAM Based In-Memory Computing

Two-Direction In-Memory Computing Based on 10T SRAM With Horizontal and Vertical Decoupled Read Ports

Batched Predecessor and Sorting with Size-Priced Information in External Memory

Quadratic Word Equations with Length Constraints, Counter Systems, and Presburger Arithmetic with Divisibility

In Situ Storing 8T SRAM-CIM Macro for Full-Array Boolean Logic and Copy Operations

Processor-Aware Cache-Oblivious Algorithms✱

Architectural Support for NVRAM Persistence in GPUs

Lightweight Data Indexing and Compression in External Memory