Abstract:Objective: Develop a novel and highly efficient framework that decodes Inferior Colliculus (IC) neural activities for phoneme recognition. Methods: We propose using Hyperdimensional Computing (HDC) to support an efficient phoneme recognition algorithm, in contrast to widely applied Deep Neural Networks (DNN). The high-dimensional representation and operations in HDC are rooted in human brain functionalities and naturally parallelizable, showing the potential for efficient neural activity analysis. Our proposed method includes a spatial and temporal-aware HDC encoder that effectively captures global and local patterns. As part of our framework, we deploy the lightweight HDC-based algorithm on a highly customizable and flexible hardware platform, i.e., Field Programmable Gate Arrays (FPGA), for optimal algorithm speedup. To evaluate our method, we record IC neural activities on gerbils while playing the sound of different phonemes. Results: We compare our proposed method with multiple baseline machine learning algorithms in recognition quality and learning efficiency, across different hardware platforms. The results show that our method generally achieves better classification quality than the best-performing baseline. Compared to the Deep Residual Neural Network (i.e., ResNet), our method shows a speedup up to 74×, 67×, 210× on CPU, GPU, and FPGA respectively. We achieve up to 15% (10%) higher accuracy in consonant (vowel) classification than ResNet. Conclusion: By leveraging brain-inspired HDC for IC neural activity encoding and phoneme classification, we achieve orders of magnitude runtime speedup while improving accuracy in various challenging task settings. Significance: Decoding IC neural activities is an important step to enhance understanding about human auditory system. However, these responses from the central auditory system are noisy and contain high variance, demanding large-scale datasets and iterative model fine-tuning. The proposed HDC-based framework is more scalable and viable for future real-world deployment thanks to its fast training and overall better quality.

L3E-HD: A Framework Enabling Efficient Ensemble in High-Dimensional Space for Language Tasks

Robust In-Memory Computing with Hyperdimensional Stochastic Representation

RegHD: Robust and Efficient Regression in Hyper-Dimensional Learning System

DistHD: A Learner-Aware Dynamic Encoding Method for Hyperdimensional Classification

Energy Efficient In-memory Hyperdimensional Encoding for Spatio-temporal Signal Processing

A Brain-Inspired Low-Dimensional Computing Classifier for Inference on Tiny Devices

Scalable edge-based hyperdimensional learning system with brain-like neural adaptation

Robust and Scalable Hyperdimensional Computing With Brain-Like Neural Adaptations

Hyperdimensional computing with holographic and adaptive encoder

An Encoding Framework for Binarized Images using HyperDimensional Computing

CascadeHD: Efficient Many-Class Learning Framework Using Hyperdimensional Computing

SupportHDC: Hyperdimensional Computing with Scalable Hypervector Sparsity

Task-Projected Hyperdimensional Computing for Multi-Task Learning

HEAL: Brain-inspired Hyperdimensional Efficient Active Learning

Real-Time and Robust Hyperdimensional Classification

In-memory hyperdimensional computing

A Hybrid Autoencoder Framework of Dimensionality Reduction for Brain-Computer Interface Decoding

Lifelong Intelligence Beyond the Edge using Hyperdimensional Computing

HDCC: A Hyperdimensional Computing compiler for classification on embedded systems and high-performance computing

In-Memory Acceleration of Hyperdimensional Genome Matching on Unreliable Emerging Technologies

Hyperdimensional Brain-Inspired Learning for Phoneme Recognition With Large-Scale Inferior Colliculus Neural Activities