A systematic review of the use of Deep Learning in Satellite Imagery for Agriculture

Brandon Victor,Zhen He,Aiden Nibali

2023-12-15

Abstract:Agricultural research is essential for increasing food production to meet the requirements of an increasing population in the coming decades. Recently, satellite technology has been improving rapidly and deep learning has seen much success in generic computer vision tasks and many application areas which presents an important opportunity to improve analysis of agricultural land. Here we present a systematic review of 150 studies to find the current uses of deep learning on satellite imagery for agricultural research. Although we identify 5 categories of agricultural monitoring tasks, the majority of the research interest is in crop segmentation and yield prediction. We found that, when used, modern deep learning methods consistently outperformed traditional machine learning across most tasks; the only exception was that Long Short-Term Memory (LSTM) Recurrent Neural Networks did not consistently outperform Random Forests (RF) for yield prediction. The reviewed studies have largely adopted methodologies from generic computer vision, except for one major omission: benchmark datasets are not utilised to evaluate models across studies, making it difficult to compare results. Additionally, some studies have specifically utilised the extra spectral resolution available in satellite imagery, but other divergent properties of satellite images - such as the hugely different scales of spatial patterns - are not being taken advantage of in the reviewed studies.

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to systematically review the research on the use of deep learning techniques in agricultural applications within satellite imagery. Specifically, the authors describe various methods of deep learning in agricultural satellite image processing by analyzing 193 related research papers and compare them with general computer vision techniques.

#### Main Objectives:
1. **Enhance Agricultural Decision-Making**: Utilize vast amounts of agricultural data to improve food security decisions from international trade policies to individual farmers.
2. **Address Agricultural Challenges**: Use satellite imagery to obtain agriculture-related information to enhance global food production in the face of challenges such as population growth and climate change.
3. **Evaluate the Effectiveness of Deep Learning Methods**: Assess the performance of models such as Convolutional Neural Networks (CNN) and Long Short-Term Memory networks (LSTM) in agricultural tasks by comparing different methods.
4. **Propose Future Research Directions**: Identify the shortcomings in current research and suggest future research directions, particularly regarding the application of multispectral data and geolocation data.

#### Research Scope:
- **Time Span**: Focuses mainly on research after 2020 but also includes some significant earlier works.
- **Task Classification**: Concentrates on two main tasks: crop segmentation and yield prediction.
- **Data Sources**: Utilizes satellite data sources such as MODIS, Landsat, and Sentinel.

Through the above analysis, the paper finds that CNN outperforms traditional machine learning methods in almost all agricultural tasks, but the performance of LSTM models in yield prediction tasks is not ideal. Additionally, the paper points out the lack of benchmark datasets and direct comparisons between methods in current research, which requires further study.