Abstract:Neural Architecture Search (NAS) is a technique for finding suitable neural network architecture models for given applications. Previously, such search methods are usually based on reinforcement learning, with a recurrent neural network to generate neural network models. However, most NAS methods aim to find a set of candidates with best cost-performance ratios, e.g. high accuracy and low computing time, based on rough estimates derived from the workload generically. As today's deep learning chips accelerate neural network operations with a variety of hardware tricks such as vectors and low-precision data formats, the estimated metrics derived from generic computing operations such as float-point operations (FLOPS) would be very different from the actual latency, throughput, power consumption, etc., which are highly sensitive to the hardware design and even the software optimization in edge AI applications. Thus, instead of taking a long time to pick and train so called good candidates repeatedly based on unreliable estimates, we propose a NAS framework which accelerates the search process by including the actual performance measurements in the search process. The inclusion of actual measurements enables the proposed NAS framework to find candidates based on correct information and reduce the possibility of selecting wrong candidates and wasting search time on wrong candidates. To illustrate the effectiveness of our framework, we prototyped the framework to work with Intel OpenVINO and Field Programmable Gate Arrays (FPGA) to meet the accuracy and latency required by the user. The framework takes the dataset, accuracy and latency requirements from the user and automatically search for candidates to meet the requirements. Case studies and experimental results are presented in this paper to evaluate the effectiveness of our framework for Edge AI applications in real-time image classification.

Edge Intelligence-Based Seismic Event Detection Using a Hardware-Efficient Neural Network With Field Programmable Gate Array

High-performance Subpixel Edge Location Based on FPGA for Horizon Sensors

An Edge AI System Based on FPGA Platform for Railway Fault Detection

Optimizing Neural Network Inference in Edge Robotics by Harnessing FPGA Hardware Acceleration

A Lightweight Detection Method for Remote Sensing Images and Its Energy-Efficient Accelerator on Edge Devices

An FPGA Accelerator Design of Spiking Neural Network for Energy-Efficient Object Detection

LCANet: Lightweight Context-Aware Attention Networks for Earthquake Detection and Phase-Picking on IoT Edge Devices

An Fpga-Based Dynamic Reconfigurable Cnn Edge Computing Device for Object Classification

A Lightweight Network for Seismic Phase Picking on Embedded Systems

Toward Fast Platform-Aware Neural Architecture Search for FPGA-Accelerated Edge AI Applications

An edge implementation of a traffic sign detection system for Advanced driver Assistance Systems

Efficient Edge Detection on Low-Cost FPGAs

Efficient Edge AI: Deploying Convolutional Neural Networks on FPGA with the Gemmini Accelerator

UHNet: An Ultra-Lightweight and High-Speed Edge Detection Network

Event-triggered Natural Hazard Monitoring with Convolutional Neural Networks on the Edge

Edge Real-Time Object Detection and DPU-Based Hardware Implementation for Optical Remote Sensing Images

CRED: A Deep Residual Network of Convolutional and Recurrent Units for Earthquake Signal Detection

Real-time FPGA Implementation of CNN-based Distributed Fiber Optic Vibration Event Recognition Method

EdgeNet: Balancing Accuracy and Performance for Edge-based Convolutional Neural Network Object Detectors

Edge FPGA-based Onsite Neural Network Training.

Towards Enabling Dynamic Convolution Neural Network Inference for Edge Intelligence