LFSD: a VSLAM Dataset with Plant Detection and Tracking in Lettuce Farm.

Shuo Wang,Daobilige Su,Maofeng Li,Yiyu Jiang,Lina Zhang,Hao Yan,Nan Hu,Yu Tan

DOI: https://doi.org/10.3389/fpls.2023.1175743

IF: 5.6

2023-01-01

Frontiers in Plant Science

Abstract:DATA REPORT article Front. Plant Sci., 29 August 2023Sec. Sustainable and Intelligent Phytoprotection Volume 14 - 2023 | https://doi.org/10.3389/fpls.2023.1175743

What problem does this paper attempt to address?

Quantifying Effect of Maize Tassels on LAI Estimation Based on Multispectral Imagery and Machine Learning Methods

Mingchao Shao,Chenwei Nie,Aijun Zhang,Liangsheng Shi,Yuanyuan Zha,Honggen Xu,Hongye Yang,Xun Yu,Yi Bai,Shuaibing Liu,Minghan Cheng,Tao Lin,Ningbo Cui,Wenbin Wu,Xiuliang Jin

DOI: https://doi.org/10.1016/j.compag.2023.108029

IF: 8.3

2023-01-01

Computers and Electronics in Agriculture

Abstract:A reliable method to estimate the leaf area index (LAI) in a field environment is crucial for precise monitoring of crop-growth status. Currently, the crop canopy information has been widely used to estimate LAI using remote sensing methods. Many studies regard canopy tassels and leaves as integrated objects, no systematic study has yet investigated how tassels affect the accuracy of LAI estimates. Moreover, the estimation accuracy and general-ization ability of the number of selected vegetation indices was seldom evaluated. Therefore, this study used deep learning segmentation methods to quantify how maize tassels affect LAI estimates and to evaluate how the number of variables affects LAI estimates. The results showed that the multispectral dataset segmentation tassels had the highest accuracy when using the VGG-encoded U-Net model (class pixel accuracy, CPA = 89.53 %; mean intersection over union, MIoU = 85.97 %). The segmentation accuracy first was increased and then decreased with tassel growth. By quantifying the contribution of tassels to the vegetation index, tassels most strongly affect the modified nonlinear vegetation index (MNLI) constructed from the canopy spectral information. Moreover, removing the tassels in images could significantly improve the accuracy of LAI estimates using the gradient-boosting decision tree method (GBDT). The estimation method obtained the highest accuracy when using nine vegetation indices to estimate the LAI (R2 = 0.816, RMSE = 0.399, rRMSE = 7.4 %). Overall, the proposed method improves the accuracy of LAI estimates, which provides crucial technical support for monitoring the LAI of maize.
Segmentation and Tracking of Vegetable Plants by Exploiting Vegetable Shape Feature for Precision Spray of Agricultural Robots

Nan Hu,Daobilige Su,Shuo Wang,Xuechang Wang,Huiyu Zhong,Zimeng Wang,Yongliang Qiao,Yu Tan

2023-06-26

Abstract:With the increasing deployment of agricultural robots, the traditional manual spray of liquid fertilizer and pesticide is gradually being replaced by agricultural robots. For robotic precision spray application in vegetable farms, accurate plant phenotyping through instance segmentation and robust plant tracking are of great importance and a prerequisite for the following spray action. Regarding the robust tracking of vegetable plants, to solve the challenging problem of associating vegetables with similar color and texture in consecutive images, in this paper, a novel method of Multiple Object Tracking and Segmentation (MOTS) is proposed for instance segmentation and tracking of multiple vegetable plants. In our approach, contour and blob features are extracted to describe unique feature of each individual vegetable, and associate the same vegetables in different images. By assigning a unique ID for each vegetable, it ensures the robot to spray each vegetable exactly once, while traversing along the farm rows. Comprehensive experiments including ablation studies are conducted, which prove its superior performance over two State-Of-The-Art (SOTA) MOTS methods. Compared to the conventional MOTS methods, the proposed method is able to re-identify objects which have gone out of the camera field of view and re-appear again using the proposed data association strategy, which is important to ensure each vegetable be sprayed only once when the robot travels back and forth. Although the method is tested on lettuce farm, it can be applied to other similar vegetables such as broccoli and canola. Both code and the dataset of this paper is publicly released for the benefit of the community: <a class="link-external link-https" href="https://github.com/NanH5837/LettuceMOTS" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Robotics
Combining computer vision and deep learning to enable ultra-scale aerial phenotyping and precision agriculture: A case study of lettuce production

Alan Bauer,Aaron George Bostrom,Joshua Ball,Christopher Applegate,Tao Cheng,Stephen Laycock,Sergio Moreno Rojas,Jacob Kirwan,Ji Zhou

DOI: https://doi.org/10.1038/s41438-019-0151-5

IF: 8.7

2019-06-01

Horticulture Research

Abstract:Aerial imagery is regularly used by crop researchers, growers and farmers to monitor crops during the growing season. To extract meaningful information from large-scale aerial images collected from the field, high-throughput phenotypic analysis solutions are required, which not only produce high-quality measures of key crop traits, but also support professionals to make prompt and reliable crop management decisions. Here, we report AirSurf, an automated and open-source analytic platform that combines modern computer vision, up-to-date machine learning, and modular software engineering in order to measure yield-related phenotypes from ultra-large aerial imagery. To quantify millions of in-field lettuces acquired by fixed-wing light aircrafts equipped with normalised difference vegetation index (NDVI) sensors, we customised AirSurf by combining computer vision algorithms and a deep-learning classifier trained with over 100,000 labelled lettuce signals. The tailored platform, AirSurf-Lettuce, is capable of scoring and categorising iceberg lettuces with high accuracy (>98%). Furthermore, novel analysis functions have been developed to map lettuce size distribution across the field, based on which associated global positioning system (GPS) tagged harvest regions have been identified to enable growers and farmers to conduct precision agricultural practises in order to improve the actual yield as well as crop marketability before the harvest.

plant sciences,genetics & heredity,horticulture
YOLO-VOLO-LS: A Novel Method for Variety Identification of Early Lettuce Seedlings

Pan Zhang,Daoliang Li

DOI: https://doi.org/10.3389/fpls.2022.806878

2022-02-24

Abstract:Accurate identification of crop varieties is an important aspect of smart agriculture, which is not only essential for the management of later crop differences, but also has a significant effect on unmanned operations in planting scenarios such as facility greenhouses. In this study, five kinds of lettuce under the cultivation conditions of greenhouses were used as the research object, and a classification model of lettuce varieties with multiple growth stages was established. First of all, we used the-state-of-the-art method VOLO-D1 to establish a variety classification model for the 7 growth stages of the entire growth process. The results found that the performance of the lettuce variety classification model in the SP stage needs to be improved, but the classification effect of the model at other stages is close to 100%; Secondly, based on the challenges of the SP stage dataset, we combined the advantages of the target detection mechanism and the target classification mechanism, innovatively proposed a new method of variety identification for the SP stage, called YOLO-VOLO-LS. Finally, we used this method to model and analyze the classification of lettuce varieties in the SP stage. The result shows that the method can achieve excellent results of 95.961, 93.452, 96.059, 96.014, 96.039 in Val-acc, Test-acc, Recall, Precision, F1-score, respectively. Therefore, the method proposed in this study has a certain reference value for the accurate identification of varieties in the early growth stage of crops.
Multimodal Data Fusion for Precise Lettuce Phenotype Estimation Using Deep Learning Algorithms

Lixin Hou,Yuxia Zhu,Mengke Wang,Ning Wei,Jiachi Dong,Yaodong Tao,Jing Zhou,Jian Zhang

DOI: https://doi.org/10.3390/plants13223217

2024-11-21

Plants

Abstract:Effective lettuce cultivation requires precise monitoring of growth characteristics, quality assessment, and optimal harvest timing. In a recent study, a deep learning model based on multimodal data fusion was developed to estimate lettuce phenotypic traits accurately. A dual-modal network combining RGB and depth images was designed using an open lettuce dataset. The network incorporated both a feature correction module and a feature fusion module, significantly enhancing the performance in object detection, segmentation, and trait estimation. The model demonstrated high accuracy in estimating key traits, including fresh weight (fw), dry weight (dw), plant height (h), canopy diameter (d), and leaf area (la), achieving an R2 of 0.9732 for fresh weight. Robustness and accuracy were further validated through 5-fold cross-validation, offering a promising approach for future crop phenotyping.

plant sciences
Growth parameter acquisition and geometric point cloud completion of lettuce

Mingzhao Lou,Jinke Lu,Le Wang,Huanyu Jiang,Mingchuan Zhou

DOI: https://doi.org/10.3389/fpls.2022.947690

IF: 5.6

2022-09-30

Frontiers in Plant Science

Abstract:The plant factory is a form of controlled environment agriculture (CEA) which is offers a promising solution to the problem of food security worldwide. Plant growth parameters need to be acquired for process control and yield estimation in plant factories. In this paper, we propose a fast and non-destructive framework for extracting growth parameters. Firstly, ToF camera (Microsoft Kinect V2) is used to obtain the point cloud from the top view, and then the lettuce point cloud is separated. According to the growth characteristics of lettuce, a geometric method is proposed to complete the incomplete lettuce point cloud. The treated point cloud has a high linear correlation with the actual plant height ( R 2 = 0.961), leaf area ( R 2 = 0.964), and fresh weight ( R 2 = 0.911) with a significant improvement compared to untreated point cloud. The result suggests our proposed point cloud completion method have has the potential to tackle the problem of obtaining the plant growth parameters from a single 3D view with occlusion.

plant sciences
Field cabbage detection and positioning system based on improved YOLOv8n

Ping Jiang,Aolin Qi,Jiao Zhong,Yahui Luo,Wenwu Hu,Yixin Shi and Tianyu Liu

DOI: https://doi.org/10.1186/s13007-024-01226-y

IF: 5.827

2024-06-21

Plant Methods

Abstract:Pesticide efficacy directly affects crop yield and quality, making targeted spraying a more environmentally friendly and effective method of pesticide application. Common targeted cabbage spraying methods often involve object detection networks. However, complex natural and lighting conditions pose challenges in the accurate detection and positioning of cabbage.

plant sciences,biochemical research methods
A real time LiDAR-Visual-Inertial object level semantic SLAM for forest environments

Hongwei Liu,Guoqi Xu,Bo Liu,Yuanxin Li,Shuhang Yang,Jie Tang,Kai Pan,Yanqiu Xing

DOI: https://doi.org/10.1016/j.isprsjprs.2024.11.013

IF: 12.7

2024-12-01

ISPRS Journal of Photogrammetry and Remote Sensing

Abstract:The accurate positioning of individual trees, the reconstruction of forest environment in three dimensions and the identification of tree species distribution are crucial aspects of forestry remote sensing. Simultaneous Localization and Mapping (SLAM) algorithms, primarily based on LiDAR or visual technologies, serve as essential tools for outdoor spatial positioning and mapping, overcoming signal loss challenges caused by tree canopy obstruction in the Global Navigation Satellite System (GNSS). To address these challenges, a semantic SLAM algorithm called LVI-ObjSemantic is proposed, which integrates visual, LiDAR, IMU and deep learning at the object level. LVI-ObjSemantic is capable of performing individual tree segmentation, localization and tree spices discrimination tasks in forest environment. The proposed Cluster-Block-single and Cluster-Block-global data structures combined with the deep learning model can effectively reduce the cases of misdetection and false detection. Due to the lack of publicly available forest datasets, we chose to validate the proposed algorithm on eight experimental plots. The experimental results indicate that the average root mean square error (RMSE) of the trajectories across the eight plots is 2.7, 2.8, 1.9 and 2.2 times lower than that of LIO-SAM, FAST-LIO2, LVI-SAM and FAST-LIVO, respectively. Additionally, the mean absolute error in tree localization is 0.12 m. Moreover, the mapping drift of the proposed algorithm is consistently lower than that of the aforementioned comparison algorithms.

imaging science & photographic technology,remote sensing,geography, physical,geosciences, multidisciplinary
From Plants to Landmarks: Time-invariant Plant Localization that uses Deep Pose Regression in Agricultural Fields

Florian Kraemer,Alexander Schaefer,Andreas Eitel,Johan Vertens,Wolfram Burgard

DOI: https://doi.org/10.48550/arXiv.1709.04751

IF: 3.7

2017-09-14

Robotics

Abstract:Agricultural robots are expected to increase yields in a sustainable way and automate precision tasks, such as weeding and plant monitoring. At the same time, they move in a continuously changing, semi-structured field environment, in which features can hardly be found and reproduced at a later time. Challenges for Lidar and visual detection systems stem from the fact that plants can be very small, overlapping and have a steadily changing appearance. Therefore, a popular way to localize vehicles with high accuracy is based on ex- pensive global navigation satellite systems and not on natural landmarks. The contribution of this work is a novel image- based plant localization technique that uses the time-invariant stem emerging point as a reference. Our approach is based on a fully convolutional neural network that learns landmark localization from RGB and NIR image input in an end-to-end manner. The network performs pose regression to generate a plant location likelihood map. Our approach allows us to cope with visual variances of plants both for different species and different growth stages. We achieve high localization accuracies as shown in detailed evaluations of a sugar beet cultivation phase. In experiments with our BoniRob we demonstrate that detections can be robustly reproduced with centimeter accuracy.
DAVIS-Ag: A Synthetic Plant Dataset for Prototyping Domain-Inspired Active Vision in Agricultural Robots

Taeyeong Choi,Dario Guevara,Zifei Cheng,Grisha Bandodkar,Chonghan Wang,Brian N. Bailey,Mason Earles,Xin Liu

2024-07-01

Abstract:In agricultural environments, viewpoint planning can be a critical functionality for a robot with visual sensors to obtain informative observations of objects of interest (e.g., fruits) from complex structures of plant with random occlusions. Although recent studies on active vision have shown some potential for agricultural tasks, each model has been designed and validated on a unique environment that would not easily be replicated for benchmarking novel methods being developed later. In this paper, we introduce a dataset, so-called DAVIS-Ag, for promoting more extensive research on Domain-inspired Active VISion in Agriculture. To be specific, we leveraged our open-source "AgML" framework and 3D plant simulator of "Helios" to produce 502K RGB images from 30K densely sampled spatial locations in 632 synthetic orchards. Moreover, plant environments of strawberries, tomatoes, and grapes are considered at two different scales (i.e., Single-Plant and Multi-Plant). Useful labels are also provided for each image, including (1) bounding boxes and (2) instance segmentation masks for all identifiable fruits, and also (3) pointers to other images of the viewpoints that are reachable by an execution of action so as to simulate active viewpoint selections at each time step. Using DAVIS-Ag, we visualize motivating examples where fruit visibility can dramatically change depending on the pose of the camera view primarily due to occlusions by other components, such as leaves. Furthermore, we present several baseline models with experiment results for benchmarking in the task of target visibility maximization. Transferability to real strawberry environments is also investigated to demonstrate the feasibility of using the dataset for prototyping real-world solutions. For future research, our dataset is made publicly available online: <a class="link-external link-https" href="https://github.com/ctyeong/DAVIS-Ag" rel="external noopener nofollow">this https URL</a>.

Robotics
Extraction of Lilium davidii var. unicolor Planting Information Based on Deep Learning and Multi-Source Data

Yinfang Shi,Puhan Zhang,Zhaoyang Wang

DOI: https://doi.org/10.3390/s24051543

IF: 3.9

2024-02-29

Sensors

Abstract:Accurate extraction of crop acreage is an important element of digital agriculture. This study uses Sentinel-2A, Sentinel-1, and DEM as data sources to construct a multidimensional feature dataset encompassing spectral features, vegetation index, texture features, terrain features, and radar features. The Relief-F algorithm is applied for feature selection to identify the optimal feature dataset. And the combination of deep learning and the random forest (RF) classification method is utilized to identify lilies in Qilihe District and Yuzhong County of Lanzhou City, obtain their planting structure, and analyze their spatial distribution characteristics in Gansu Province. The findings indicate that terrain features significantly contribute to ground object classification, with the highest classification accuracy when the number of features in the feature dataset is 36. The precision of the deep learning classification method exceeds that of RF, with an overall classification accuracy and kappa coefficient of 95.9% and 0.934, respectively. The Lanzhou lily planting area is 137.24 km2, and it primarily presents a concentrated and contiguous distribution feature. The study's findings can serve as a solid scientific foundation for Lanzhou City's lily planting structure adjustment and optimization and a basis of data for local lily yield forecasting, development, and application.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
TSP-yolo-based Deep Learning Method for Monitoring Cabbage Seedling Emergence

Xin Chen,Teng Liu,Kang Han,Xiaojun Jin,Jinxu Wang,Xiaotong Kong,Jialin Yu

DOI: https://doi.org/10.1016/j.eja.2024.127191

IF: 5.2

2024-01-01

European Journal of Agronomy

Abstract:Real-time monitoring of seedling emergence is vital for vegetable crop management and yield estimation. Traditionally, crop seedling emergence monitoring relies on low-efficient and time-consuming manual counting. To address this issue, this research proposed an efficient, fast, and real-time cabbage seedling counting method (combining the improved YOLOv8n, tracking algorithm, and image processing) to accurately track cabbage seedlings in the field and implement counting with an unmanned aerial vehicle (UAV). The improved YOLOv8n replaced the C2f Block in the YOLO backbone with a Swin-conv block and incorporated ParNet attention modules in both the backbone and neck parts. This enhancement enables the YOLOv8n to surpass the base model's performance, achieving a mAP50-95 of 90.3 %, representing a 14.5 % improvement. The experiments demonstrated the superior capabilities of the counting method in terms of speed and accuracy. In field experiments, the proposed Tracking algorithms-Swin-conv blocks-ParNet attention-YOLOv8n (TSP-yolo) counting method demonstrated consistent and reliable accuracy in counting cabbage seedlings while demanding only one-seventh of the time needed compared to the manual counting method. In summary, based on TSP-yolo and implemented through an UAV, the developed seedling emergence counting method demonstrated an excellent capability of counting cabbage seedlings, resulting in significant savings in human resources for crop management.
Improved Multi-Size, Multi-Target and 3D Position Detection Network for Flowering Chinese Cabbage Based on YOLOv8

Yuanqing Shui,Kai Yuan,Mengcheng Wu,Zuoxi Zhao

DOI: https://doi.org/10.3390/plants13192808

2024-10-08

Plants

Abstract:Accurately detecting the maturity and 3D position of flowering Chinese cabbage (Brassica rapa var. chinensis) in natural environments is vital for autonomous robot harvesting in unstructured farms. The challenge lies in dense planting, small flower buds, similar colors and occlusions. This study proposes a YOLOv8-Improved network integrated with the ByteTrack tracking algorithm to achieve multi-object detection and 3D positioning of flowering Chinese cabbage plants in fields. In this study, C2F-MLCA is created by adding a lightweight Mixed Local Channel Attention (MLCA) with spatial awareness capability to the C2F module of YOLOv8, which improves the extraction of spatial feature information in the backbone network. In addition, a P2 detection layer is added to the neck network, and BiFPN is used instead of PAN to enhance multi-scale feature fusion and small target detection. Wise-IoU in combination with Inner-IoU is adopted as a new loss function to optimize the network for different quality samples and different size bounding boxes. Lastly, ByteTrack is integrated for video tracking, and RGB-D camera depth data are used to estimate cabbage positions. The experimental results show that YOLOv8-Improve achieves a precision (P) of 86.5% and a recall (R) of 86.0% in detecting the maturity of flowering Chinese cabbage. Among them, mAP50 and mAP75 reach 91.8% and 61.6%, respectively, representing an improvement of 2.9% and 4.7% over the original network. Additionally, the number of parameters is reduced by 25.43%. In summary, the improved YOLOv8 algorithm demonstrates high robustness and real-time detection performance, thereby providing strong technical support for automated harvesting management.

plant sciences
Improved YOLO v7 for Sustainable Agriculture Significantly Improves Precision Rate for Chinese Cabbage (Brassica pekinensis Rupr.) Seedling Belt (CCSB) Detection

Xiaomei Gao,Gang Wang,Jiangtao Qi,Qingxia (Jenny) Wang,Meiqi Xiang,Kexin Song,Zihao Zhou

DOI: https://doi.org/10.3390/su16114759

IF: 3.9

2024-06-04

Sustainability

Abstract:Precise navigation in agricultural applications necessitates accurate guidance from the seedling belt, which the Global Positioning System (GPS) alone cannot provide. The overlapping leaves of Chinese cabbage (Brassica pekinensis Rupr.) present significant challenges for seedling belt fitting due to difficulties in plant identification. This study aims to address these challenges by improving the You Only Look Once (YOLO) v7 model with a novel approach that decouples its network head deriving from the Faster-Regions with Convolutional Neural Network (Faster R-CNN) architecture. Additionally, this study introduced a BiFormer attention mechanism to accurately identify the centers of overlapping Chinese cabbages. Using these identified centers and pixel distance verification, this study achieved precise fitting of the Chinese cabbage seedling belt (CCSB). Our experimental results demonstrated a significant improvement in performance metrics, with our improved model achieving a 2.5% increase in mean average precision compared to the original YOLO v7. Furthermore, our approach attained a 94.2% accuracy in CCSB fitting and a 91.3% Chinese cabbage identification rate. Compared to traditional methods such as the Hough transform and linear regression, our method showed an 18.6% increase in the CCSB identification rate and a 17.6% improvement in angle accuracy. The novelty of this study lies in the innovative combination of the YOLO v7 model with a decoupled head and the BiFormer attention mechanism, which together advance the identification and fitting of overlapping leafy vegetables. This advancement supports intelligent weeding, reduces the reliance on chemical herbicides, and promotes safer, more sustainable agricultural practices. Our research not only improves the accuracy of overlapping vegetable identification, but also provides a robust framework for enhancing precision agriculture.

environmental sciences,environmental studies,green & sustainable science & technology
A Fine-Tuned RetinaNet for Real-Time Lettuce Detection

Eko Wahyu Prasetyo,Hidetaka Nambo

DOI: https://doi.org/10.24843/lkjiti.2024.v15.i01.p02

2024-03-25

Abstract:The agricultural industry plays a vital role in the global demand for food production. Along with population growth, there is an increasing need for efficient farming practices that can maximize crop yields. Conventional methods of harvesting lettuce often rely on manual labor, which can be time-consuming, labor-intensive, and prone to human error. These challenges lead to research into automation technology, such as robotics, to improve harvest efficiency and reduce reliance on human intervention. Deep learning-based object detection models have shown impressive success in various computer vision tasks, such as object recognition. RetinaNet model can be trained to identify and localize lettuce accurately. However, the pre-trained models must be fine-tuned to adapt to the specific characteristics of lettuce, such as shape, size, and occlusion, to deploy object recognition models in real-world agricultural scenarios. Fine-tuning the models using lettuce-specific datasets can improve their accuracy and robustness for detecting and localizing lettuce. The data acquired for RetinaNet has the highest accuracy of 0.782, recall of 0.844, f1-score of 0.875, and mAP of 0,962. Metrics evaluate that the higher the score, the better the model performs.
Vision based crop row navigation under varying field conditions in arable fields

Rajitha de Silva,Grzegorz Cielniak,Junfeng Gao

DOI: https://doi.org/10.1016/j.compag.2023.108581

IF: 8.3

2024-01-11

Computers and Electronics in Agriculture

Abstract:Accurate crop row detection is often challenged by the varying field conditions present in real-world arable fields. Traditional colour based segmentation is unable to cater for all such variations. The lack of comprehensive datasets in agricultural environments limits the researchers from developing robust segmentation models to detect crop rows. We present a dataset for crop row detection with 11 field variations from sugar beet and maize crops. We also present a novel crop row detection algorithm for visual servoing in crop row fields. The proposed method uses deep learning based crop row skeleton segmentation method followed by a crop row scanning algorithm that identifies the central crop row which the robot then follows. The unique dataset we used with skeleton representations for crop row detection enables robust crop row detection in challenging real world field conditions. Our algorithm can detect crop rows against varying field conditions such as curved crop rows, weed presence, discontinuities, growth stages, tramlines, shadows and light levels. Dense weed presence within inter-row space and discontinuities in crop rows were the most challenging field conditions for our crop row detection algorithm. An End-of Row detector algorithm was developed to detect the end of the crop row and navigate the robot towards the headland area when it reaches the end of the crop row.

agriculture, multidisciplinary,computer science, interdisciplinary applications
An Image Labeling Tool and Agricultural Dataset for Deep Learning

Patrick Wspanialy,Justin Brooks,Medhat Moussa

DOI: https://doi.org/10.48550/arXiv.2004.03351

2020-04-06

Computer Vision and Pattern Recognition

Abstract:We introduce a labeling tool and dataset aimed to facilitate computer vision research in agriculture. The annotation tool introduces novel methods for labeling with a variety of manual, semi-automatic, and fully-automatic tools. The dataset includes original images collected from commercial greenhouses, images from PlantVillage, and images from Google Images. Images were annotated with segmentations for foreground leaf, fruit, and stem instances, and diseased leaf area. Labels were in an extended COCO format. In total the dataset contained 10k tomatoes, 7k leaves, 2k stems, and 2k diseased leaf annotations.
Crop Identification Using Deep Learning on LUCAS Crop Cover Photos

Momchil Yordanov,Raphaël d’Andrimont,Laura Martinez-Sanchez,Guido Lemoine,Dominique Fasbender,Marijn van der Velde,Raphaël d'Andrimont

DOI: https://doi.org/10.3390/s23146298

IF: 3.9

2023-07-12

Sensors

Abstract:Massive and high-quality in situ data are essential for Earth-observation-based agricultural monitoring. However, field surveying requires considerable organizational effort and money. Using computer vision to recognize crop types on geo-tagged photos could be a game changer allowing for the provision of timely and accurate crop-specific information. This study presents the first use of the largest multi-year set of labelled close-up in situ photos systematically collected across the European Union from the Land Use Cover Area frame Survey (LUCAS). Benefiting from this unique in situ dataset, this study aims to benchmark and test computer vision models to recognize major crops on close-up photos statistically distributed spatially and through time between 2006 and 2018 in a practical agricultural policy relevant context. The methodology makes use of crop calendars from various sources to ascertain the mature stage of the crop, of an extensive paradigm for the hyper-parameterization of MobileNet from random parameter initialization, and of various techniques from information theory in order to carry out more accurate post-processing filtering on results. The work has produced a dataset of 169,460 images of mature crops for the 12 classes, out of which 15,876 were manually selected as representing a clean sample without any foreign objects or unfavorable conditions. The best-performing model achieved a macro F1 (M-F1) of 0.75 on an imbalanced test dataset of 8642 photos. Using metrics from information theory, namely the equivalence reference probability, resulted in an increase of 6%. The most unfavorable conditions for taking such images, across all crop classes, were found to be too early or late in the season. The proposed methodology shows the possibility of using minimal auxiliary data outside the images themselves in order to achieve an M-F1 of 0.82 for labelling between 12 major European crops.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Maize plant detection using UAV-based RGB imaging and YOLOv5

Chenghao Lu,Emmanuel Nnadozie,Moritz Paul Camenzind,Yuncai Hu,Kang Yu

DOI: https://doi.org/10.3389/fpls.2023.1274813

IF: 5.6

2024-01-04

Frontiers in Plant Science

Abstract:In recent years, computer vision (CV) has made enormous progress and is providing great possibilities in analyzing images for object detection, especially with the application of machine learning (ML). Unmanned Aerial Vehicle (UAV) based high-resolution images allow to apply CV and ML methods for the detection of plants or their organs of interest. Thus, this study presents a practical workflow based on the You Only Look Once version 5 (YOLOv5) and UAV images to detect maize plants for counting their numbers in contrasting development stages, including the application of a semi-auto-labeling method based on the Segment Anything Model (SAM) to reduce the burden of labeling. Results showed that the trained model achieved a mean average precision (mAP@0.5) of 0.828 and 0.863 for the 3-leaf stage and 7-leaf stage, respectively. YOLOv5 achieved the best performance under the conditions of overgrown weeds, leaf occlusion, and blurry images, suggesting that YOLOv5 plays a practical role in obtaining excellent performance under realistic field conditions. Furthermore, introducing image-rotation augmentation and low noise weight enhanced model accuracy, with an increase of 0.024 and 0.016 mAP@0.5, respectively, compared to the original model of the 3-leaf stage. This work provides a practical reference for applying lightweight ML and deep learning methods to UAV images for automated object detection and characterization of plant growth under realistic environments.

plant sciences
Automatic Counting and Location Labeling of Rice Seedlings from Unmanned Aerial Vehicle Images

Jui-Feng Yeh,Kuei-Mei Lin,Li-Ching Yuan,Jenq-Muh Hsu

DOI: https://doi.org/10.3390/electronics13020273

IF: 2.9

2024-01-09

Electronics

Abstract:Traditional counting of rice seedlings in agriculture is often labor-intensive, time-consuming, and prone to errors. Therefore, agricultural automation has gradually become a prominent solution. In this paper, UVA detection, combining deep learning with unmanned aerial vehicle (UAV) sensors, contributes to precision agriculture. We propose a YOLOv4-based approach for the counting and location marking of rice seedlings from unmanned aerial vehicle (UAV) images. The detection of tiny objects is a crucial and challenging task in agricultural imagery. Therefore, we make modifications to the data augmentation and activation functions in the neural elements of the deep learning model to meet the requirements of rice seedling detection and counting. In the preprocessing stage, we segment the UAV images into different sizes for training. Mish activation is employed to enhance the accuracy of the YOLO one-stage detector. We utilize the dataset provided in the AIdea 2021 competition to evaluate the system, achieving an F1-score of 0.91. These results indicate the superiority of the proposed method over the baseline system. Furthermore, the outcomes affirm the potential for precise detection of rice seedlings in precision agriculture.

engineering, electrical & electronic,computer science, information systems,physics, applied

LFSD: a VSLAM Dataset with Plant Detection and Tracking in Lettuce Farm.

Quantifying Effect of Maize Tassels on LAI Estimation Based on Multispectral Imagery and Machine Learning Methods

Segmentation and Tracking of Vegetable Plants by Exploiting Vegetable Shape Feature for Precision Spray of Agricultural Robots

Combining computer vision and deep learning to enable ultra-scale aerial phenotyping and precision agriculture: A case study of lettuce production

YOLO-VOLO-LS: A Novel Method for Variety Identification of Early Lettuce Seedlings

Multimodal Data Fusion for Precise Lettuce Phenotype Estimation Using Deep Learning Algorithms

Growth parameter acquisition and geometric point cloud completion of lettuce

Field cabbage detection and positioning system based on improved YOLOv8n

A real time LiDAR-Visual-Inertial object level semantic SLAM for forest environments

From Plants to Landmarks: Time-invariant Plant Localization that uses Deep Pose Regression in Agricultural Fields

DAVIS-Ag: A Synthetic Plant Dataset for Prototyping Domain-Inspired Active Vision in Agricultural Robots

Extraction of Lilium davidii var. unicolor Planting Information Based on Deep Learning and Multi-Source Data

TSP-yolo-based Deep Learning Method for Monitoring Cabbage Seedling Emergence

Improved Multi-Size, Multi-Target and 3D Position Detection Network for Flowering Chinese Cabbage Based on YOLOv8

Improved YOLO v7 for Sustainable Agriculture Significantly Improves Precision Rate for Chinese Cabbage (Brassica pekinensis Rupr.) Seedling Belt (CCSB) Detection

A Fine-Tuned RetinaNet for Real-Time Lettuce Detection

Vision based crop row navigation under varying field conditions in arable fields

An Image Labeling Tool and Agricultural Dataset for Deep Learning

Crop Identification Using Deep Learning on LUCAS Crop Cover Photos

Maize plant detection using UAV-based RGB imaging and YOLOv5

Automatic Counting and Location Labeling of Rice Seedlings from Unmanned Aerial Vehicle Images