Abstract:Binary spatter code (BSC)-based hyperdimensional computing (HDC) is a highly error-resilient approximate computational paradigm suited for error-prone, emerging hardware platforms. In BSC HDC, the basic datatype is a hypervector, a typically large binary vector, where the size of the hypervector has a significant impact on the fidelity and resource usage of the computation. Typically, the hypervector size is dynamically tuned to deliver the desired accuracy; this process is time-consuming and often produces hypervector sizes that lack accuracy guarantees and produce poor results when reused for very similar workloads. We present Heim, a hardware-aware static analysis and optimization framework for BSC HD computations. Heim analytically derives the minimum hypervector size that minimizes resource usage and meets the target accuracy requirement. Heim guarantees the optimized computation converges to the user-provided accuracy target on expectation, even in the presence of hardware error. Heim deploys a novel static analysis procedure that unifies theoretical results from the neuroscience community to systematically optimize HD computations. We evaluate Heim against dynamic tuning-based optimization on 25 benchmark data structures. Given a 99% accuracy requirement, Heim-optimized computations achieve a 99.2%-100.0% median accuracy, up to 49.5% higher than dynamic tuning-based optimization, while achieving 1.15x-7.14x reductions in hypervector size compared to HD computations that achieve comparable query accuracy and finding parametrizations 30.0x-100167.4x faster than dynamic tuning-based approaches. We also use Heim to systematically evaluate the performance benefits of using analog CAMs and multiple-bit-per-cell ReRAM over conventional hardware, while maintaining iso-accuracy -- for both emerging technologies, we find usages where the emerging hardware imparts significant benefits.

Hardware-Aware Static Optimization of Hyperdimensional Computations

Robust In-Memory Computing with Hyperdimensional Stochastic Representation

Hardware Optimizations of Dense Binary Hyperdimensional Computing: Rematerialization of Hypervectors, Binarized Bundling, and Combinational Associative Memory

FeFET-Based In-Memory Hyperdimensional Encoding Design

MicroHD: An Accuracy-Driven Optimization of Hyperdimensional Computing Algorithms for TinyML systems

SupportHDC: Hyperdimensional Computing with Scalable Hypervector Sparsity

HPVM-HDC: A Heterogeneous Programming System for Accelerating Hyperdimensional Computing

Achieving software-equivalent accuracy for hyperdimensional computing with ferroelectric-based in-memory computing

In-Memory Acceleration of Hyperdimensional Genome Matching on Unreliable Emerging Technologies

A 5 μW Standard Cell Memory-based Configurable Hyperdimensional Computing Accelerator for Always-on Smart Sensing

SHEARer: Highly-Efficient Hyperdimensional Computing by Software-Hardware Enabled Multifold Approximation

In-memory hyperdimensional computing

Sobol Sequence Optimization for Hardware-Efficient Vector Symbolic Architectures

HDCC: A Hyperdimensional Computing compiler for classification on embedded systems and high-performance computing

Energy Efficient In-memory Hyperdimensional Encoding for Spatio-temporal Signal Processing

SearcHD: A Memory-Centric Hyperdimensional Computing with Stochastic Training

Hdc-Im: Hyperdimensional Computing In-Memory Architecture Based On Rram

Memristor-Based Approximate Query Architecture for In-Memory Hyperdimensional Computing

PAAP-HD: PIM-Assisted Approximation for Efficient Hyper-Dimensional Computing

uHD: Unary Processing for Lightweight and Dynamic Hyperdimensional Computing

Hyperdimensional computing with holographic and adaptive encoder