Abstract:Event cameras have emerged as a promising sensing modality for autonomous navigation systems, owing to their high temporal resolution, high dynamic range and negligible motion blur. To process the asynchronous temporal event streams from such sensors, recent research has shown that a mix of Artificial Neural Networks (ANNs), Spiking Neural Networks (SNNs) as well as hybrid SNN-ANN algorithms are necessary to achieve high accuracies across a range of perception tasks. However, we observe that executing such workloads on commodity edge platforms which feature heterogeneous processing elements such as CPUs, GPUs and neural accelerators results in inferior performance. This is due to the mismatch between the irregular nature of event streams and diverse characteristics of algorithms on the one hand and the underlying hardware platform on the other. We propose Ev-Edge, a framework that contains three key optimizations to boost the performance of event-based vision systems on edge platforms: (1) An Event2Sparse Frame converter directly transforms raw event streams into sparse frames, enabling the use of sparse libraries with minimal encoding overheads (2) A Dynamic Sparse Frame Aggregator merges sparse frames at runtime by trading off the temporal granularity of events and computational demand thereby improving hardware utilization (3) A Network Mapper maps concurrently executing tasks to different processing elements while also selecting layer precision by considering both compute and communication overheads. On several state-of-art networks for a range of autonomous navigation tasks, Ev-Edge achieves 1.28x-2.05x improvements in latency and 1.23x-2.15x in energy over an all-GPU implementation on the NVIDIA Jetson Xavier AGX platform for single-task execution scenarios. Ev-Edge also achieves 1.43x-1.81x latency improvements over round-robin scheduling methods in multi-task execution scenarios.

Improving Performance-Power-Programmability in Space Avionics with Edge Devices: VBN on Myriad2 SoC

High-Performance Embedded Computing in Space: Evaluation of Platforms for Vision-Based Navigation

Accelerating AI and Computer Vision for Satellite Pose Estimation on the Intel Myriad X Embedded SoC

MPAI: A Co-Processing Architecture with MPSoC & AI Accelerators for Vision Applications in Space

Optimization of Processor-to-Hardware Module Communications on Spaceborne Hybrid FPGA-based Architectures

Co-design of a novel CMOS highly parallel, low-power, multi-chip neural network accelerator

Innovative Architecture of Single Chip Edge Device Based on Virtualization Technology.

Comparative Analysis of Next-Generation Space Computing Applications on AMD-Xilinx Versal Architecture

Memory-Oriented Design-Space Exploration of Edge-AI Hardware for XR Applications

Performance Evaluation of Neuromorphic Hardware for Onboard Satellite Communication Applications

Mitigating Challenges of the Space Environment for Onboard Artificial Intelligence: Design Overview of the Imaging Payload on SpIRIT

Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework

Ev-Edge: Efficient Execution of Event-based Vision Algorithms on Commodity Edge Platforms

Energy-Efficient Synthetic-Aperture Radar Processing on a Manycore Architecture

An Evaluation of Low-Cost Vision Processors for Efficient Star Identification

Exploring In-Memory Accelerators and FPGAs for Latency-Sensitive DNN Inference on Edge Servers

Reaching the Edge of the Edge: Image Analysis in Space

Implementation of an Edge-Computing Vision System on Reduced-Board Computers Embedded in UAVs for Intelligent Traffic Management

Energy-Efficient On-Board Radio Resource Management for Satellite Communications via Neuromorphic Computing

Resource-constrained FPGA Design for Satellite Component Feature Extraction

Reconfigurable Multi-processor On-board Computer for Small Satellites and Small Launch Vehicles