Abstract:The rapid development of remote sensing technology has brought about a sharp increase in the amount of remote sensing image data. However, due to the satellite's limited hardware resources, space, and power consumption constraints, it is difficult to process massive remote sensing images efficiently and robustly using the traditional remote sensing image processing methods. Additionally, the task of satellite-to-ground target detection has higher requirements for speed and accuracy under the conditions of more and more remote sensing data. To solve these problems, this paper proposes an extremely efficient and reliable acceleration architecture for forward inference of the YOLOX-s detection network an on-orbit FPGA. Considering the limited onboard resources, the design strategy of the parallel loop unrolling of the input channels and output channels is adopted to build the largest DSP computing array to ensure a reliable and full utilization of the limited computing resources, thus reducing the inference delay of the entire network. Meanwhile, a three-path cache queue and a small-scale cascaded pooling array are designed, which maximize the reuse of on-chip cache data, effectively reduce the bandwidth bottleneck of the external memory, and ensure an efficient computing of the entire computing array. The experimental results show that at the 200 MHz operating frequency of the VC709, the overall inference performance of the FPGA acceleration can reach 399.62 GOPS, the peak performance can reach 408.4 GOPS, and the overall computing efficiency of the DSP array can reach 97.56%. Compared with the previous work, our architecture design further improves the computing efficiency under limited hardware resources.

An FPGA-GPU Heterogeneous System and Implementation for On-Board Remote Sensing Data Processing

FPGA-based Design of Real-time Video Processing Platform

Design and Experiment of Prototype System for Parallel Processing of Remote Sensing Images Based on FPGA

Design of A High-speed Infrared Image Processing Platform Based on the Multi-core DSP and FPGA

On-Board, Real-Time Preprocessing System for Optical Remote-Sensing Imagery

Constrained Optimization of FPGA Design for Spaceborne InSAR Processing.

Design and implementation of a real-time signal processor for astronomical opto-electronic observation system

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

Heterogeneous FPGA+GPU Embedded Systems: Challenges and Opportunities

Optimization of Processor-to-Hardware Module Communications on Spaceborne Hybrid FPGA-based Architectures

A Power Efficient Neural Network Implementation on Heterogeneous FPGA and GPU Devices

Design of onboard image real-time processing system based on FPGA

Evaluating the Potential of Graphics Processors for High Performance Embedded Computing

A Heterogeneous Dual-Core High-Speed Processing System for High Resolution Catadioptric Panorama

3D Waveform Oscilloscope Implemented on Coupled FPGA-GPU Embedded System

A DSP/FPGA - Based Parallel Architecture for Real-time Image Processing

Design of high-speed real-time sensor image processing based on FPGA and DDR3

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Real-time Image Processing System Using FPGA with Hardware Software Collaborative Processing

High Speed Real-Time Signal Processing System

Implementation of a High-Throughput OFDM System Using Graphics Processing Units