Abstract:The rapid development of remote sensing technology has brought about a sharp increase in the amount of remote sensing image data. However, due to the satellite's limited hardware resources, space, and power consumption constraints, it is difficult to process massive remote sensing images efficiently and robustly using the traditional remote sensing image processing methods. Additionally, the task of satellite-to-ground target detection has higher requirements for speed and accuracy under the conditions of more and more remote sensing data. To solve these problems, this paper proposes an extremely efficient and reliable acceleration architecture for forward inference of the YOLOX-s detection network an on-orbit FPGA. Considering the limited onboard resources, the design strategy of the parallel loop unrolling of the input channels and output channels is adopted to build the largest DSP computing array to ensure a reliable and full utilization of the limited computing resources, thus reducing the inference delay of the entire network. Meanwhile, a three-path cache queue and a small-scale cascaded pooling array are designed, which maximize the reuse of on-chip cache data, effectively reduce the bandwidth bottleneck of the external memory, and ensure an efficient computing of the entire computing array. The experimental results show that at the 200 MHz operating frequency of the VC709, the overall inference performance of the FPGA acceleration can reach 399.62 GOPS, the peak performance can reach 408.4 GOPS, and the overall computing efficiency of the DSP array can reach 97.56%. Compared with the previous work, our architecture design further improves the computing efficiency under limited hardware resources.

Real-Time Visual Inertial Odometry with a Resource-Efficient Harris Corner Detection Accelerator on FPGA Platform

A Reconfigurable Visual-Inertial Odometry Accelerated Core with High Area and Energy Efficiency for Autonomous Mobile Robots

High-performance Subpixel Edge Location Based on FPGA for Horizon Sensors

High-Performance Visual Odometry with Two-Stage Local Binocular Ba and Gpu

Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVs

A 325 FPS Corner-Detection Accelerator with Hardware-Oriented Optimization.

Real Time FPGA Implementation of an Efficient High Speed Harris Corner Detection Algorithm Based on High-Level Synthesis

RLP‐VIO: Robust and Lightweight Plane‐based Visual‐inertial Odometry for Augmented Reality

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Robust and Efficient Visual-Inertial Odometry with Multi-plane Priors.

Edge Real-Time Object Detection and DPU-Based Hardware Implementation for Optical Remote Sensing Images

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

An Efficient Real-Time FPGA-Based ORB Feature Extraction for an UHD Video Stream for Embedded Visual SLAM

An FPGA-based Real-Time Simultaneous Localization and Mapping System.

Robust Tightly-Coupled Visual-Inertial Odometry with Pre-built Maps in High Latency Situations

An FPGA Acceleration and Optimization Techniques for 2D LiDAR SLAM Algorithm

Real-time low-power binocular stereo vision based on FPGA

An FPGA-Based YOLOv5 Accelerator for Real-Time Industrial Vision Applications

An FPGA Based Energy Efficient DS-SLAM Accelerator for Mobile Robots in Dynamic Environment

Visual Inertial Odometry using Focal Plane Binary Features (BIT-VIO)