Forward-Forward Algorithm for Hyperspectral Image Classification: A Preliminary Study

Sidike Paheding,Abel A. Reyes-Angulo

2023-07-01

Abstract:The back-propagation algorithm has long been the de-facto standard in optimizing weights and biases in neural networks, particularly in cutting-edge deep learning models. Its widespread adoption in fields like natural language processing, computer vision, and remote sensing has revolutionized automation in various tasks. The popularity of back-propagation stems from its ability to achieve outstanding performance in tasks such as classification, detection, and segmentation. Nevertheless, back-propagation is not without its limitations, encompassing sensitivity to initial conditions, vanishing gradients, overfitting, and computational complexity. The recent introduction of a forward-forward algorithm (FFA), which computes local goodness functions to optimize network parameters, alleviates the dependence on substantial computational resources and the constant need for architectural scaling. This study investigates the application of FFA for hyperspectral image classification. Experimental results and comparative analysis are provided with the use of the traditional back-propagation algorithm. Preliminary results show the potential behind FFA and its promises.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The main objective of this paper is to explore the application of the Forward-Forward Algorithm (FFA) in hyperspectral image classification tasks and to evaluate its advantages and limitations compared to traditional backpropagation algorithms. Specifically:

1. **Addressing the limitations of backpropagation algorithms**: Although backpropagation algorithms are widely used and effective in deep learning, they have some issues when dealing with hyperspectral data, such as sensitivity to initial conditions, gradient vanishing, overfitting, and high computational complexity. FFA, as an alternative method, aims to overcome these problems by reducing the dependence on extensive computational resources.

2. **Exploring the application of FFA in hyperspectral image classification**: Investigate whether FFA can be effectively applied to hyperspectral image classification tasks and compare it with traditional backpropagation algorithms.

3. **Proposing a hybrid training method**: Given that using FFA alone has not shown better results than backpropagation, the authors propose a hybrid method that combines FFA pre-training with backpropagation fine-tuning, aiming to leverage the advantages of both to improve classification performance.

Experiments validate the effectiveness of the proposed hybrid method and demonstrate that this approach can indeed bring performance improvements on certain datasets. Overall, this paper attempts to improve the effectiveness of hyperspectral image classification tasks by introducing FFA and its combination with backpropagation algorithms.