Abstract:In the Internet of Things (IoT) domain, many applications are running machine learning algorithms to assimilate the data collected in the swarm of devices. Sending all data to the powerful computing environment, e.g., cloud, poses significant efficiency and scalability issues. A promising way is to distribute the learning tasks onto the IoT hierarchy, often referred to edge computing; however, the existing sophisticated algorithms such as deep learning are often overcomplex to run on less-powerful and unreliable embedded IoT devices. Hyperdimensional Computing (HDC) is a brain-inspired learning approach for efficient and robust learning on today's embedded devices. Encoding, or transforming the input data into high-dimensional representation, is the key first step of HDC before performing a learning task. All existing HDC approaches use a static encoder; thus, they still require very high dimensionality, resulting in significant efficiency loss for the edge devices with limited resources. In this paper, we have developed NeuralHD, a new HDC approach with a dynamic encoder for adaptive learning. Inspired by human neural regeneration study in neuroscience, NeuralHD identifies insignificant dimensions and regenerates those dimensions to enhance the learning capability and robustness. We also present a scalable learning framework to distribute NeuralHD computation over edge devices in IoT systems. Our solution enables edge devices capable of real-time learning from both labeled and unlabeled data. Our evaluation on a wide range of practical classification tasks shows that NeuralHD provides $5.7 imes$ and $6.1 imes(12.3 imes$ and $14.1 imes$) faster and more energy-efficient training compared to the HD-based algorithms (DNNs) running on the same platform. NeuralHD also provide $4.2 imes$ and $11.6 imes$ higher robustness to noise in the unreliable network and hardware of IoT environments as compared to DNNs.

SearcHD: A Memory-Centric Hyperdimensional Computing with Stochastic Training

Robust In-Memory Computing with Hyperdimensional Stochastic Representation

FeFET-Based In-Memory Hyperdimensional Encoding Design

RegHD: Robust and Efficient Regression in Hyper-Dimensional Learning System

Energy Efficient In-memory Hyperdimensional Encoding for Spatio-temporal Signal Processing

In-memory hyperdimensional computing

Hardware Optimizations of Dense Binary Hyperdimensional Computing: Rematerialization of Hypervectors, Binarized Bundling, and Combinational Associative Memory

Store-n-Learn: Classification and Clustering with Hyperdimensional Computing across Flash Hierarchy

SHEARer: Highly-Efficient Hyperdimensional Computing by Software-Hardware Enabled Multifold Approximation

Exploring Hyperdimensional Associative Memory

Hyperdimensional computing with holographic and adaptive encoder

Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework

Hdc-Im: Hyperdimensional Computing In-Memory Architecture Based On Rram

2T2R RRAM-Based In-Memory Hyperdimensional Computing Encoder for Spatio-Temporal Signal Processing

A ReRAM-Based Processing-In-Memory Architecture for Hyperdimensional Computing

A 5 μW Standard Cell Memory-based Configurable Hyperdimensional Computing Accelerator for Always-on Smart Sensing

uHD: Unary Processing for Lightweight and Dynamic Hyperdimensional Computing

Task-Projected Hyperdimensional Computing for Multi-Task Learning

Scalable edge-based hyperdimensional learning system with brain-like neural adaptation

Exploring Embedding Methods in Binary Hyperdimensional Computing: A Case Study for Motor-Imagery based Brain-Computer Interfaces

In-Memory Acceleration of Hyperdimensional Genome Matching on Unreliable Emerging Technologies