Abstract:There is a need for machine learning models to evolve in unsupervised circumstances. New classifications may be introduced, unexpected faults may occur, or the initial dataset may be small compared to the data-points presented to the system during normal operation. Implementing such a system using neural networks involves significant mathematical complexity, which is a major issue in power-critical edge applications. This paper proposes a novel field-programmable gate-array infrastructure for online learning, implementing a low-complexity machine learning algorithm called the Tsetlin Machine. This infrastructure features a custom-designed architecture for run-time learning management, providing on-chip offline and online learning. Using this architecture, training can be carried out on-demand on the \ac{FPGA} with pre-classified data before inference takes place. Additionally, our architecture provisions online learning, where training can be interleaved with inference during operation. Tsetlin Machine (TM) training naturally descends to an optimum, with training also linked to a threshold hyper-parameter which is used to reduce the probability of issuing feedback as the TM becomes trained further. The proposed architecture is modular, allowing the data input source to be easily changed, whilst inbuilt cross-validation infrastructure allows for reliable and representative results during system testing. We present use cases for online learning using the proposed infrastructure and demonstrate the energy/performance/accuracy trade-offs.

Accelerating On-Line Training of LS-SVM with Run-Time Reconfiguration

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

Scalable SVM Processor and Its Application to Nonlinear Channel Equalization

MapReduce-based scalable architecture for implementing SVM in hardware

A Reconfigurable Computing Engine for Wavelet Transforms

A Fast On-Chip SVM-Training System with Dual-Mode Configurable Pipelines and MSMO Scheduler

Research and Implementation of Ε-Svr Training Method Based on FPGA

FPGA-based Distributed Edge Training of SVM

An Energy-Efficient Parallel VLSI Architecture for SVM Classification

An Exploration Framework for Efficient High-Level Synthesis of Support Vector Machines: Case Study on ECG Arrhythmia Detection for Xilinx Zynq SoC

An Optimization Toolchain Design Of Deep Learning Deployment Based On Heterogeneous Computing Platform

Implementing a SoC-FPGA Based Acceleration System for On-Board SVM Training for Robotic Transtibial Prostheses.

Parallelization of Computing-Intensive Tasks of SIFT Algorithm on a Reconfigurable Architecture System

Case Study: Optimization Methods With TVM Hybrid-OP on RISC-V Packed SIMD

Instruction Set Extension and Hardware Acceleration for SVM Application Toward a Vector Processor.

An FPGA Architecture for Online Learning using the Tsetlin Machine

Fast On-Line Real-Time Scheduling Algorithm for Reconfigurable Computing.

Parallel and Distributed Structured SVM Training

A Microcoded Kernel Recursive Least Squares Processor Using FPGA Technology.

Run-time configuration prefetching to reduce the overhead of dynamically reconfiguration

Design And Implementation Of Reconfigurable Stream Processor In Multimedia Applications