Abstract:Binary spatter code (BSC)-based hyperdimensional computing (HDC) is a highly error-resilient approximate computational paradigm suited for error-prone, emerging hardware platforms. In BSC HDC, the basic datatype is a hypervector, a typically large binary vector, where the size of the hypervector has a significant impact on the fidelity and resource usage of the computation. Typically, the hypervector size is dynamically tuned to deliver the desired accuracy; this process is time-consuming and often produces hypervector sizes that lack accuracy guarantees and produce poor results when reused for very similar workloads. We present Heim, a hardware-aware static analysis and optimization framework for BSC HD computations. Heim analytically derives the minimum hypervector size that minimizes resource usage and meets the target accuracy requirement. Heim guarantees the optimized computation converges to the user-provided accuracy target on expectation, even in the presence of hardware error. Heim deploys a novel static analysis procedure that unifies theoretical results from the neuroscience community to systematically optimize HD computations. We evaluate Heim against dynamic tuning-based optimization on 25 benchmark data structures. Given a 99% accuracy requirement, Heim-optimized computations achieve a 99.2%-100.0% median accuracy, up to 49.5% higher than dynamic tuning-based optimization, while achieving 1.15x-7.14x reductions in hypervector size compared to HD computations that achieve comparable query accuracy and finding parametrizations 30.0x-100167.4x faster than dynamic tuning-based approaches. We also use Heim to systematically evaluate the performance benefits of using analog CAMs and multiple-bit-per-cell ReRAM over conventional hardware, while maintaining iso-accuracy -- for both emerging technologies, we find usages where the emerging hardware imparts significant benefits.

The CBE Hardware Accelerator for Numerical Relativity: A Simple Approach

Implementation of elliptic curve cryptography accelerator

Large Scale Numerical Simulation Via Parallelization and Reconfigurable Computing Hardware

Efficient Algorithms for Monte Carlo Particle Transport on AI Accelerator Hardware

A Scalable and Reconfigurable Bit-Serial Compute-Near-Memory Hardware Accelerator for Solving 2-D/3-D Partial Differential Equations

Achieving Performance Portability in Gaussian Basis Set Density Functional Theory on Accelerator Based Architectures in NWChemEx

Efficiently Emulating High-Bitwidth Computation with Low-Bitwidth Hardware

Hardware-Aware Static Optimization of Hyperdimensional Computations

Programming Bare-Metal Accelerators with Heterogeneous Threading Models: A Case Study of Matrix-3000

Application-level Studies of Cellular Neural Network-based Hardware Accelerators

The Parallel Compact Object CALculator: An Efficient General Relativistic Initial Data Solver for Compact Objects

Accelerating and Tuning Small Matrix Multiplications on Sunway TaihuLight: A Case Study of Spectral Element CFD Code Nek5000

AHA: An Agile Approach to the Design of Coarse-Grained Reconfigurable Accelerators and Compilers

Towards a Peta-scale Unstructured Computational Fluid Dynamics (CFD) Acceleration Toolkit Based on Sunway Architectures?

Huicore: A Generalized Hardware Accelerator for Complicated Functions

Extracting the Potential of Emerging Hardware Accelerators for Symmetric Eigenvalue Decomposition

Providing performance portable numerics for Intel GPUs

GPU-accelerated Effective Hamiltonian Calculator

Automating GPU Scalability for Complex Scientific Models: Phonon Boltzman Transport Equation

GPU acceleration and performance of the particle-beam-dynamics code Elegant

GPU Acceleration of Numerical Atomic Orbitals-Based Density Functional Theory Algorithms within the ABACUS package