Abstract:Deep learning techniques have provided significant improvements in hyperspectral image (HSI) classification. The current deep learning-based HSI classifiers follow a patch-based learning framework by dividing the image into overlapping patches. As such, these methods are local learning methods, which have a high computational cost. In this article, a fast patch-free global learning (FPGA) framework is proposed for HSI classification. The proposed framework consists of three main parts: 1) a designed sampling strategy; 2) an encoder–decoder-based fully convolutional network (FCN); and 3) lateral connections between the encoder and decoder. In FPGA, an encoder–decoder-based FCN is utilized to consider the global spatial information by processing the whole image, which results in fast inference. However, it is difficult to directly utilize the encoder–decoder-based FCN for HSI classification as it always fails to converge due to the insufficiently diverse gradients caused by the limited training samples. To solve the divergence problem and maintain the FCNs abilities of fast inference and global spatial information mining, a global stochastic stratified (GS 2 ) sampling strategy is first proposed by transforming all the training samples into a stochastic sequence of stratified samples. This strategy can obtain diverse gradients to guarantee the convergence of the FCN in the FPGA framework. For a better design of FCN architecture, FreeNet, which is a fully end-to-end network for HSI classification, is proposed to maximize the exploitation of the global spatial information and boost the performance via a spectral attention-based encoder and a lightweight decoder. A lateral connection module is also designed to connect the encoder and decoder, fusing the spatial details in the encoder and the semantic features in the decoder. The experimental results obtained using three public benchmark data sets suggest that the FPGA framework is superior to the patch-based framework in both speed and accuracy for HSI classification.

Fpga Based Implementation Of Convolutional Neural Network For Hyperspectral Classification

Configurable 2D–3D CNNs Accelerator for FPGA-Based Hyperspectral Imagery Classification

Optimizing CNN-based Hyperspectral Image Classification on FPGAs

Hardware Implementation of Convolutional Neural Network-Based Remote Sensing Image Classification Method.

Automatic Deployment of Convolutional Neural Networks on FPGA for Spaceborne Remote Sensing Application

FPGA Implementation for CNN-Based Optical Remote Sensing Object Detection

Caffeinated FPGAs: FPGA Framework For Convolutional Neural Networks

Implementation of Convolutional Neural Network with Co-design of High-Level Synthesis and Verilog HDL

FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification.

Design of Convolutional Neural Network Based on FPGA

Design and Implementation of CNN Traffic Lights Classification Based on FPGA

Design of Fully Spectral CNNs for Efficient FPGA-Based Acceleration

Application and Implementation of Convolutional Neural Network Accelerator Based on FPGA in Environmental Sound Classification.

FPNet: Customized Convolutional Neural Network for FPGA Platforms

A Scalable FPGA Accelerator for Convolutional Neural Networks.

A Data-Center FPGA Acceleration Platform for Convolutional Neural Networks

A Novel CNN Architecture on FPGA-based SoC for Remote Sensing Image Classification

Going Deeper with Embedded FPGA Platform for Convolutional Neural Network

An FPGA-Based CNN Accelerator Integrating Depthwise Separable Convolution

FPGA Implementation of Quantized Convolutional Neural Networks.