Abstract:Neural networks are the state-of-the-art solution to image-processing tasks. Some of these neural networks are relatively simple, but the popular convolutional neural networks (CNNs) can consist of hundreds of layers. Unfortunately, the excellent recognition accuracy of CNNs comes at the cost of very high computational complexity, and one of the current challenges is managing the power, delay and physical size limitations of hardware solutions dedicated to accelerating their inference process. In this paper, we describe the embedding of an eye detection system on a Zynq XCZU4EV UltraScale+ multiprocessor system-on-chip (MPSoC). This eye detector is used in the application framework of a remote iris recognition system, which requires high resolution images captured at high speed as input. Given the high rate of eye regions detected per second, it is also important that the detector only provides as output images eyes that are in focus, discarding all those seriously affected by defocus blur. In this proposal, the network will be trained only with correctly focused eye images to assess whether it can differentiate this pattern from that associated with the out-of-focus eye image. Exploiting the neural network’s advantage of being able to work with multi-channel input, the inputs to the CNN will be the grey level image and a high-pass filtered version, typically used to determine whether the iris is in focus or not. The complete system synthetises other cores and implements CNN using the so-called Deep Learning Processor Unit (DPU), the intellectual property (IP) block released by AMD/Xilinx. Compared to previous hardware designs for implementing FPGA-based CNNs, the DPU IP supports extensive deep learning core functions, and developers can leverage DPUs to conveniently accelerate CNN inference. Experimental validation has been successfully addressed in a real-world scenario working with walking subjects, demonstrating that it is possible to detect only eye images that are in focus. This prototype module includes a CMOS digital image sensor that provides 16 Mpixel images, and outputs a stream of detected eyes as 640 × 480 images. The module correctly discards up to 95% of the eyes present in the input images as not being correctly focused.

Hybrid FPGA-CPU pupil tracker

Gaze Tracking System Based on Pupil Detection

Infrared Small Target Tracking Based on Sopc

High-performance Subpixel Edge Location Based on FPGA for Horizon Sensors

Design and FPGA Implementation of a Light-Weight Calibration-Friendly Eye Gaze Tracking Algorithm

Research on A Fast Location Algorithm for Human Eye Center Used in Automatic Optometry Unit

Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interaction

Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNN

A FPGA Based High-Speed Binocular Active Vision System for Tracking Circle-Shaped Target

An FPGA Based Tracking Implementation for Parkinson's Patients

SOPC-based Real-Time Spots Detection and Ordering for an Artificial Compound Eye of 3D Object Detection

Motion Object Tracking System Based on FPGA

FPGA-Based CNN for Eye Detection in an Iris Recognition at a Distance System

Development of an Eye Tracking-Based Human-Computer Interface for Real-Time Applications

PupilNet v2.0: Convolutional Neural Networks for CPU based real time Robust Pupil Detection

Design Of High-Resolution Digital Microscope Eyepiece Based On Fpga

A Framework for Pupil Tracking with Event Cameras

A Pupil Localization Method Based on Dual Threshold and Contour Compensation.

FPGA-based Acceleration System for Visual Tracking

Study of the Retina Algorithm on FPGA for Fast Tracking

RemoteEye: An open-source high-speed remote eye tracker