Abstract:Machine Learning (ML) has recently been a skyrocketing field in Computer Science. As computer hardware engineers, we are enthusiastic about hardware implementations of popular software ML architectures to optimize their performance, reliability, and resource usage. In this project, we designed a highly-configurable, real-time device for recognizing handwritten letters and digits using an Altera DE1 FPGA Kit. We followed various engineering standards, including IEEE-754 32-bit Floating-Point Standard, Video Graphics Array (VGA) display protocol, Universal Asynchronous Receiver-Transmitter (UART) protocol, and Inter-Integrated Circuit (I2C) protocols to achieve the project goals. These significantly improved our design in compatibility, reusability, and simplicity in verifications. Following these standards, we designed a 32-bit floating-point (FP) instruction set architecture (ISA). We developed a 5-stage RISC processor in System Verilog to manage image processing, matrix multiplications, ML classifications, and user interfaces. Three different ML architectures were implemented and evaluated on our design: Linear Classification (LC), a 784-64-10 fully connected neural network (NN), and a LeNet-like Convolutional Neural Network (CNN) with ReLU activation layers and 36 classes (10 for the digits and 26 for the case-insensitive letters). The training processes were done in Python scripts, and the resulting kernels and weights were stored in hex files and loaded into the FPGA's SRAM units. Convolution, pooling, data management, and various other ML features were guided by firmware in our custom assembly language. This paper documents the high-level design block diagrams, interfaces between each System Verilog module, implementation details of our software and firmware components, and further discussions on potential impacts.

Handwritten digit recognition system on an FPGA

FPGA-BASED DEVICE FOR HANDWRITTEN DIGIT RECOGNITION IN IMAGES

Digit Recognition Based on Programmable Nanophotonic Processor

FPGA Implementation of Convolutional Neural Network for Real-Time Handwriting Recognition

FPGA Implementation of Hand-written Number Recognition Based on CNN

A Programmable Artificial Neural Network Coprocessor for Handwritten Digit Recognition

Design of FPGA-based Handwriting Image Recognition System

FPGA Implementation of Feature Extraction and Neural Network Classifier for Handwritten Digit Recognition

FPGA Implementation of CNN for Handwritten Digit Recognition

FPGA Simulation of Fingertip Digit Recognition Using CNN

Design and Implementation of Handwritten Digit Recognition Accelerator Based on Systolic Array

FPGA Based Implementation of Deep Neural Networks Using On-chip Memory Only

Deep neural network accelerator based on FPGA

A neuromorphic hardware architecture using the Neural Engineering Framework for pattern recognition

Field-programmable gate array implementation of a probabilistic neural network for motor cortical decoding in rats.

A Real-time P-SFA hardware implementation of Deep Neural Networks using FPGA

FPGA Implementation of Feed-Forward MLP Neural Networks

An FPGA Accelerated Method for Training Feed-forward Neural Networks Using Alternating Direction Method of Multipliers and LSMR

FP-BNN: Binarized neural network on FPGA

HARDWARE ACCELERATOR: IMPLEMENTATION OF CNN ON FPGA FOR DIGIT RECOGNITION

FPGA Implementation for the Sigmoid with Piecewise Linear Fitting Method Based on Curvature Analysis