Abstract:Hyper-Spectral Imaging (HSI) is a crucial technique for analysing remote sensing data acquired from Earth observation satellites. The rich spatial and spectral information obtained through HSI allows for better characterisation and exploration of the Earth's surface over traditional techniques like RGB and Multi-Spectral imaging on the downlinked image data at ground stations. Sometimes, these images do not contain meaningful information due to the presence of clouds or other artefacts, limiting their usefulness. Transmission of such artefact HSI images leads to wasteful use of already scarce energy and time costs required for communication. While detecting such artefacts before transmitting the HSI image is desirable, the computational complexity of these algorithms and the limited power budget on satellites (especially CubeSats) are key constraints. This paper presents an unsupervised learning-based convolutional autoencoder (CAE) model for artefact identification of acquired HSI images at the satellite and a deployment architecture on AMD's Zynq Ultrascale FPGAs. The model is trained and tested on widely used HSI image datasets: Indian Pines, Salinas Valley, the University of Pavia and the Kennedy Space Center. For deployment, the model is quantised to 8-bit precision, fine-tuned using the Vitis-AI framework and integrated as a subordinate accelerator using AMD's Deep-Learning Processing Units (DPU) instance on the Zynq device. Our tests show that the model can process each spectral band in an HSI image in 4 ms, 2.6x better than INT8 inference on Nvidia's Jetson platform & 1.27x better than SOTA artefact detectors. Our model also achieves an f1-score of 92.8% and FPR of 0% across the dataset, while consuming 21.52 mJ per HSI image, 3.6x better than INT8 Jetson inference & 7.5x better than SOTA artefact detectors, making it a viable architecture for deployment in CubeSats.

A Scalable Dataflow Accelerator for Real Time Onboard Hyperspectral Image Classification.

MapReduce-based scalable architecture for implementing SVM in hardware

Optimizing CNN-based Hyperspectral Image Classification on FPGAs

Resources and Power Efficient FPGA Accelerators for Real-Time Image Classification

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Dynamic Vision Sensor integration on FPGA-based CNN accelerators for high-speed visual classification

An Exploration Framework for Efficient High-Level Synthesis of Support Vector Machines: Case Study on ECG Arrhythmia Detection for Xilinx Zynq SoC

FPGA Implementation of a Hardware Optimized Automatic Target Detection and Classification Algorithm for Hyperspectral Image Analysis

An Efficient FPGA-Based Implementation for Quantized Remote Sensing Image Scene Classification Network

A High-Speed Low-Cost VLSI System Capable of On-Chip Online Learning for Dynamic Vision Sensor Data Classification

Hybrid CNN-SVM Inference Accelerator on FPGA Using HLS

A Scalable Hybrid Architecture for High Performance Data-Parallel Applications

FPGA-Based Feature Extraction and Tracking Accelerator for Real-Time Visual SLAM

Efficient depthwise separable convolution accelerator for classification and UAV object detection

A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs

An Energy-Efficient Artefact Detection Accelerator on FPGAs for Hyper-Spectral Satellite Imagery

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

High-Level Synthesis of Multiclass SVM Using Code Refactoring to Classify Brain Cancer from Hyperspectral Images

Hardware Acceleration and Implementation of YOLOX-s for On-Orbit FPGA

A Real-Time FPGA Accelerator Based on Winograd Algorithm for Underwater Object Detection