Abstract:The total boll count from a plant is one of the most important phenotypic traits for cotton breeding and is also an important factor for growers to estimate the final yield. With the recent advances in deep learning, many supervised learning approaches have been implemented to perform phenotypic trait measurement from images for various crops, but few studies have been conducted to count cotton bolls from field images. Supervised learning models require a vast number of annotated images for training, which has become a bottleneck for machine learning model development. The goal of this study is to develop both fully supervised and weakly supervised deep learning models to segment and count cotton bolls from proximal imagery. A total of 290 RGB images of cotton plants from both potted (indoor and outdoor) and in-field settings were taken by consumer-grade cameras and the raw images were divided into 4350 image tiles for further model training and testing. Two supervised models (Mask R-CNN and S-Count) and two weakly supervised approaches (WS-Count and CountSeg) were compared in terms of boll count accuracy and annotation costs. The results revealed that the weakly supervised counting approaches performed well with RMSE values of 1.826 and 1.284 for WS-Count and CountSeg, respectively, whereas the fully supervised models achieve RMSE values of 1.181 and 1.175 for S-Count and Mask R-CNN, respectively, when the number of bolls in an image patch is less than 10. In terms of data annotation costs, the weakly supervised approaches were at least 10 times more cost efficient than the supervised approach for boll counting. In the future, the deep learning models developed in this study can be extended to other plant organs, such as main stalks, nodes, and primary and secondary branches. Both the supervised and weakly supervised deep learning models for boll counting with low-cost RGB images can be used by cotton breeders, physiologists, and growers alike to improve crop breeding and yield estimation.

Self-Supervised Learning for Panoptic Segmentation of Multiple Fruit Flower Species

Multispecies Fruit Flower Detection Using a Refined Semantic Segmentation Network

In Defense Of Multi-Source Omni-Supervised Efficient Convnet For Robust Semantic Segmentation In Heterogeneous Unseen Domains

Omnisupervised Omnidirectional Semantic Segmentation

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Labour-saving Detection of Hybrid Rice Rows at the Pollination Stage Based on a Multi-Perturbed Semi-Supervised Model

Self-Supervised Leaf Segmentation under Complex Lighting Conditions

Combining Supervised and Un-supervised Learning for Automatic Citrus Segmentation

Few-Shot Fruit Segmentation via Transfer Learning

A self-supervised overlapped multiple weed and crop leaf segmentation approach under complex light condition

Multi-source Pseudo-label Learning of Semantic Segmentation for the Scene Recognition of Agricultural Mobile Robots

Supervised and Weakly Supervised Deep Learning for Segmentation and Counting of Cotton Bolls Using Proximal Imagery

Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards

Self-trained Panoptic Segmentation

Fully Self-Supervised Learning for Semantic Segmentation

Improving Semantic Segmentation via Self-Training

Semantic Segmentation of Fruits on Multi-sensor Fused Data in Natural Orchards

Performance Evaluation of Semi-supervised Learning Frameworks for Multi-Class Weed Detection

Enlisting 3D Crop Models and GANs for More Data Efficient and Generalizable Fruit Detection

Bagging Improves the Performance of Deep Learning-Based Semantic Segmentation with Limited Labeled Images: A Case Study of Crop Segmentation for High-Throughput Plant Phenotyping

Semi-Supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning