Abstract:Accurately mapping croplands is an important prerequisite for precision farming since it assists in field management, yield-prediction, and environmental management. Crops are sensitive to planting patterns and some have a limited capacity to compensate for gaps within a row. Optical imaging with sensors mounted on Unmanned Aerial Vehicles (UAV) is a cost-effective option for capturing images covering croplands nowadays. However, visual inspection of such images can be a challenging and biased task, specifically for detecting plants and rows on a one-step basis. Thus, developing an architecture capable of simultaneously extracting plant individually and plantation-rows from UAV-images is yet an important demand to support the management of agricultural systems. In this paper, we propose a novel deep learning method based on a Convolutional Neural Network (CNN) that simultaneously detects and geolocates plantation-rows while counting its plants considering highly-dense plantation configurations. The experimental setup was evaluated in (a) a cornfield (Zea mays L.) with different growth stages (i.e. recently planted and mature plants) and in a (b) Citrus orchard (Citrus Sinensis Pera). Both datasets characterize different plant density scenarios, in different locations, with different types of crops, and from different sensors and dates. This scheme was used to prove the robustness of the proposed approach, allowing a broader discussion of the method. A two-branch architecture was implemented in our CNN method, where the information obtained within the plantation-row is updated into the plant detection branch and retro-feed to the row branch; which are then refined by a Multi-Stage Refinement method. In the corn plantation datasets (with both growth phases – young and mature), our approach returned a mean absolute error (MAE) of 6.224 plants per image patch, a mean relative error (MRE) of 0.1038, precision and recall values of 0.856, and 0.905, respectively, and an F-measure equal to 0.876. These results were superior to the results from other deep networks (HRNet, Faster R-CNN, and RetinaNet) evaluated with the same task and dataset. For the plantation-row detection, our approach returned precision, recall, and F-measure scores of 0.913, 0.941, and 0.925, respectively. To test the robustness of our model with a different type of agriculture, we performed the same task in the citrus orchard dataset. It returned an MAE equal to 1.409 citrus-trees per patch, MRE of 0.0615, precision of 0.922, recall of 0.911, and F-measure of 0.965. For the citrus plantation-row detection, our approach resulted in precision, recall, and F-measure scores equal to 0.965, 0.970, and 0.964, respectively. The proposed method achieved state-of-the-art performance for counting and geolocating plants and plant-rows in UAV images from different types of crops. The method proposed here may be applied to future decision-making models and could contribute to the sustainable management of agricultural systems.

Identification and Counting of Sugarcane Seedlings in the Field Using Improved Faster R-CNN

Accurate Strawberry Plant Detection System Based on Low-altitude Remote Sensing and Deep Learning Technologies

Automatic Counting of in situ Rice Seedlings from UAV Images Based on a Deep Fully Convolutional Neural Network

Detection of Strawberry Flowers in Outdoor Field by Deep Neural Network

Rice Plant Counting, Locating, and Sizing Method Based on High-Throughput UAV RGB Images

A Convolutional Neural Network-Based Method for Corn Stand Counting in the Field

Precision Agriculture: Computer Vision-Enabled Sugarcane Plant Counting in the Tillering Phase

DeepSeedling: deep convolutional network and Kalman filter for plant seedling detection and counting in the field

Estimation of sorghum seedling number from drone image based on support vector machine and YOLO algorithms

Automated Counting of Rice Panicle by Applying Deep Learning Model to Images from Unmanned Aerial Vehicle Platform

Plant Counting of Cotton from UAS Imagery Using Deep Learning-Based Object Detection Framework

Sorghum Panicle Detection and Counting Using Unmanned Aerial System Images and Deep Learning

Automatic counting of rapeseed inflorescences using deep learning method and UAV RGB imagery

A CNN approach to simultaneously count plants and detect plantation-rows from UAV imagery

Sugarcane stem node detection and localization for cutting using deep learning

Sugarcane Stem Node Recognition in Field by Deep Learning Combining Data Expansion

Estimating maize seedling number with UAV RGB images and advanced image processing methods

Automatic Counting and Location Labeling of Rice Seedlings from Unmanned Aerial Vehicle Images

Rapeseed Stand Count Estimation at Leaf Development Stages With UAV Imagery and Convolutional Neural Networks

Cotton Stand Counting from Unmanned Aerial System Imagery Using MobileNet and CenterNet Deep Learning Models

A fast and robust method for plant count in sunflower and maize at different seedling stages using high-resolution UAV RGB imagery