Abstract:On-board processing has become an inevitable choice for the development of remote sensing satellites. For the satellites with dual-line array asynchronous push-broom mode, image registration is crucial for pixel localization and alignment between dual-band strip data. However, due to the high computational complexity of feature detection and feature extraction, it is still a challenge to realize real-time registration for on-board edge devices with limited computing power and power consumption. Therefore, this paper proposes a hardwareoptimized architecture with high-performance and low-energy for on-board registration based on “ARM+FPGA”. On one hand, optimized methods for the image registration algorithm are proposed from both software and hardware perspectives, providing a solution for on-board registration. On the other hand, in the face of the current interface environment of satellites, a design scheme for versatile hardware architecture is proposed. It provides a foundational technical route for hardware deployment of on-board processing. Experimental results show that in this hardware-accelerated architecture, the average acceleration effect of registration algorithm can reach 15 times compared to the unoptimized version. Additionally, the average power consumption is reduced by 60%, and the hardware resource utilization is less than 40%. Importantly, the algorithm's accuracy remains unaffected by these optimizations. The onboard intelligent processing payload deployed with this hardware architecture has been successfully launched and validated in February 2022 in the orbit of the MN200Sar-1 satellite from China. It improves the real-time capability for on-board processing, and aims to achieve a new imaging mechanism where target and information transmission replace strip image transmission.

Remote sensing image registration method based on embedded FPGA accelerated ORB algorithm

Sad-Based Stereo Vision Machine on A System-On-Programmable-Chip (Sopc)

High-performance Subpixel Edge Location Based on FPGA for Horizon Sensors

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

ORB-based SLAM accelerator on SoC FPGA

An Efficient Real-Time FPGA-Based ORB Feature Extraction for an UHD Video Stream for Embedded Visual SLAM

Hardware-Optimized Architecture of On-board Registration for Remote-Sensing Images ——Take SURF as an Example

Real-Time Visual Inertial Odometry with a Resource-Efficient Harris Corner Detection Accelerator on FPGA Platform

An Efficient FPGA-Based Implementation for Quantized Remote Sensing Image Scene Classification Network

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Research and Implementation of Binocular Image Stitching Algorithm Based on FPGA

On-Board, Real-Time Preprocessing System for Optical Remote-Sensing Imagery

Resource-constrained FPGA Design for Satellite Component Feature Extraction

Design and Implement of Median Filter Toward Remote Sensing Images Based on FPGA

A Fast Ultraviolet/Visible Image Registration Realization Based on FPGA

FPGA-based Efficient Implementation of SURF Algorithm

Real-Time Spaceborne Synthetic Aperture Radar Float-Point Imaging System Using Optimized Mapping Methodology and a Multi-Node Parallel Accelerating Technique

Real-time low-power binocular stereo vision based on FPGA

Design of onboard image real-time processing system based on FPGA

Design and Experiment of Prototype System for Parallel Processing of Remote Sensing Images Based on FPGA