Abstract:In the Internet of Things (IoT) domain, many applications are running machine learning algorithms to assimilate the data collected in the swarm of devices. Sending all data to the powerful computing environment, e.g., cloud, poses significant efficiency and scalability issues. A promising way is to distribute the learning tasks onto the IoT hierarchy, often referred to edge computing; however, the existing sophisticated algorithms such as deep learning are often overcomplex to run on less-powerful and unreliable embedded IoT devices. Hyperdimensional Computing (HDC) is a brain-inspired learning approach for efficient and robust learning on today's embedded devices. Encoding, or transforming the input data into high-dimensional representation, is the key first step of HDC before performing a learning task. All existing HDC approaches use a static encoder; thus, they still require very high dimensionality, resulting in significant efficiency loss for the edge devices with limited resources. In this paper, we have developed NeuralHD, a new HDC approach with a dynamic encoder for adaptive learning. Inspired by human neural regeneration study in neuroscience, NeuralHD identifies insignificant dimensions and regenerates those dimensions to enhance the learning capability and robustness. We also present a scalable learning framework to distribute NeuralHD computation over edge devices in IoT systems. Our solution enables edge devices capable of real-time learning from both labeled and unlabeled data. Our evaluation on a wide range of practical classification tasks shows that NeuralHD provides $5.7 imes$ and $6.1 imes(12.3 imes$ and $14.1 imes$) faster and more energy-efficient training compared to the HD-based algorithms (DNNs) running on the same platform. NeuralHD also provide $4.2 imes$ and $11.6 imes$ higher robustness to noise in the unreliable network and hardware of IoT environments as compared to DNNs.

Spiking-HDC: A Spiking Neural Network Processor with HDC Classifier Enabling Transfer Learning

Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

A Time-to-first-spike Coding and Conversion Aware Training for Energy-Efficient Deep Spiking Neural Network Processor Design

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

Scalable edge-based hyperdimensional learning system with brain-like neural adaptation

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

NBSSN: A Neuromorphic Binary Single-Spike Neural Network for Efficient Edge Intelligence.

A Cost-Efficient High-Speed VLSI Architecture for Spiking Convolutional Neural Network Inference Using Time-Step Binary Spike Maps

Hardware/Software co-design with ADC-Less In-memory Computing Hardware for Spiking Neural Networks

Implementation of Field-Programmable Gate Array Platform for Object Classification Tasks Using Spike-Based Backpropagated Deep Convolutional Spiking Neural Networks

High-speed, low-power, and configurable on-chip training acceleration platform for spiking neural networks

SupportHDC: Hyperdimensional Computing with Scalable Hypervector Sparsity

Direct Training for Spiking Neural Networks: Faster, Larger, Better

A 1024-Neuron 1M-Synapse Event-Driven SNN Accelerator for DVS Applications

An AER-based spiking convolution neural network system for image classification with low latency and high energy efficiency