Abstract:Hyper-Spectral Imaging (HSI) is a crucial technique for analysing remote sensing data acquired from Earth observation satellites. The rich spatial and spectral information obtained through HSI allows for better characterisation and exploration of the Earth's surface over traditional techniques like RGB and Multi-Spectral imaging on the downlinked image data at ground stations. Sometimes, these images do not contain meaningful information due to the presence of clouds or other artefacts, limiting their usefulness. Transmission of such artefact HSI images leads to wasteful use of already scarce energy and time costs required for communication. While detecting such artefacts before transmitting the HSI image is desirable, the computational complexity of these algorithms and the limited power budget on satellites (especially CubeSats) are key constraints. This paper presents an unsupervised learning-based convolutional autoencoder (CAE) model for artefact identification of acquired HSI images at the satellite and a deployment architecture on AMD's Zynq Ultrascale FPGAs. The model is trained and tested on widely used HSI image datasets: Indian Pines, Salinas Valley, the University of Pavia and the Kennedy Space Center. For deployment, the model is quantised to 8-bit precision, fine-tuned using the Vitis-AI framework and integrated as a subordinate accelerator using AMD's Deep-Learning Processing Units (DPU) instance on the Zynq device. Our tests show that the model can process each spectral band in an HSI image in 4 ms, 2.6x better than INT8 inference on Nvidia's Jetson platform & 1.27x better than SOTA artefact detectors. Our model also achieves an f1-score of 92.8% and FPR of 0% across the dataset, while consuming 21.52 mJ per HSI image, 3.6x better than INT8 Jetson inference & 7.5x better than SOTA artefact detectors, making it a viable architecture for deployment in CubeSats.

What problem does this paper attempt to address?

### Problems Addressed by the Paper The paper aims to address the issue of artifact detection in hyperspectral satellite images (HSI). Specifically, it focuses on deploying an efficient artifact detection accelerator on satellites to reduce the waste of energy and communication resources caused by transmitting useless images. ### Background and Motivation 1. **Importance of Hyperspectral Imaging (HSI)**: - HSI is a crucial technology for analyzing remote sensing data acquired by Earth observation satellites. - The rich spatial and spectral information obtained through HSI can better characterize and explore the Earth's surface, surpassing traditional RGB and multispectral imaging technologies. 2. **Artifact Problem**: - In some cases, these images do not contain meaningful information due to the presence of clouds or other artifacts, limiting their utility. - Transmitting these artifact-laden HSI images leads to a waste of scarce energy and time resources. 3. **Existing Challenges**: - Detecting these artifacts before transmission is ideal, but existing algorithms have high computational complexity, and the power budget on satellites (especially CubeSats) is limited, becoming a critical constraint. ### Solution 1. **Model Design**: - The paper proposes an unsupervised learning-based convolutional autoencoder (CAE) model to identify artifacts in acquired HSI images on satellites. - The model was trained and tested on widely used HSI image datasets such as Indian Pines, Salinas Valley, University of Pavia, and Kennedy Space Center. 2. **Hardware Deployment**: - The model was quantized to 8-bit precision and fine-tuned using the Vitis-AI framework, then integrated into AMD's Zynq Ultrascale FPGA as a slave accelerator. - An instance of AMD's Deep Learning Processing Unit (DPU) was integrated to achieve efficient inference. ### Experimental Results 1. **Performance Evaluation**: - Test results show that the model can process each spectral band of HSI images within 4 milliseconds, 2.6 times faster than INT8 inference on the Nvidia Jetson platform, and 1.27 times faster than the state-of-the-art artifact detector. - The model achieved an F1 score of 92.8% and a false positive rate of 0% across multiple datasets, with energy consumption per HSI image of only 21.52 millijoules, 3.6 times lower than INT8 inference on the Nvidia Jetson platform, and 7.5 times lower than the state-of-the-art artifact detector. 2. **Resource Utilization**: - On the ZCU104 development board, the model's per-frame latency is 4 milliseconds, with a frame rate of 250 FPS, idle power consumption of 4.6 watts, and total power consumption of 5.38 watts. - Compared to other methods such as CloudScout and CloudSatNet, the model demonstrates excellent resource utilization. ### Conclusion The paper presents an efficient artifact detection accelerator capable of real-time artifact detection in HSI images on satellites, significantly reducing the waste of energy and communication resources. By deploying the quantized CAE model on FPGA, a balance of high performance and low power consumption is achieved, making it suitable for applications in small satellites such as CubeSats.

An Energy-Efficient Artefact Detection Accelerator on FPGAs for Hyper-Spectral Satellite Imagery

FPGA Implementation of a Hardware Optimized Automatic Target Detection and Classification Algorithm for Hyperspectral Image Analysis

A Configurable Accelerator for CNN‐Based Remote Sensing Object Detection on FPGAs

Optimizing CNN-based Hyperspectral Image Classification on FPGAs

Leveraging Seed Generation for Efficient Hardware Acceleration of Lossless Compression of Remotely Sensed Hyperspectral Images

A Lightweight Detection Method for Remote Sensing Images and Its Energy-Efficient Accelerator on Edge Devices

Resources and Power Efficient FPGA Accelerators for Real-Time Image Classification

Resource-constrained FPGA Design for Satellite Component Feature Extraction

An Efficient FPGA-Based Implementation for Quantized Remote Sensing Image Scene Classification Network

Reaching the Edge of the Edge: Image Analysis in Space

Efficient depthwise separable convolution accelerator for classification and UAV object detection

HyperSense: Hyperdimensional Intelligent Sensing for Energy-Efficient Sparse Data Processing

A Parallel Architecture and Implementation for Near-Lossless Hyperspectral Image Compression Based on CCSDS 123.0-B-2 With Scalable Data-Rate Performance

HDSuper: High-Quality and High Computational Utilization Edge Super-Resolution Accelerator With Hardware-Algorithm Co-Design Techniques

High Performance Hyperspectral Image Classification using Graphics Processing Units

Automatic Deployment of Convolutional Neural Networks on FPGA for Spaceborne Remote Sensing Application

A Real-Time FPGA Accelerator Based on Winograd Algorithm for Underwater Object Detection

SAS-SEINet: A SNR-Aware Adaptive Scalable SEI Neural Network Accelerator Using Algorithm–Hardware Co-Design for High-Accuracy and Power-Efficient UAV Surveillance

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

Efficient Edge AI: Deploying Convolutional Neural Networks on FPGA with the Gemmini Accelerator