TasselNetV2+: A Fast Implementation for High-Throughput Plant Counting From High-Resolution RGB Imagery

Hao Lu,Zhiguo Cao

DOI: https://doi.org/10.3389/fpls.2020.541960

IF: 5.6

2020-12-07

Frontiers in Plant Science

Abstract:Plant counting runs through almost every stage of agricultural production from seed breeding, germination, cultivation, fertilization, pollination to yield estimation, and harvesting. With the prevalence of digital cameras, graphics processing units and deep learning-based computer vision technology, plant counting has gradually shifted from traditional manual observation to vision-based automated solutions. One of popular solutions is a state-of-the-art object detection technique called Faster R-CNN where plant counts can be estimated from the number of bounding boxes detected. It has become a standard configuration for many plant counting systems in plant phenotyping. Faster R-CNN, however, is expensive in computation, particularly when dealing with high-resolution images. Unfortunately high-resolution imagery is frequently used in modern plant phenotyping platforms such as unmanned aerial vehicles, engendering inefficient image analysis. Such inefficiency largely limits the throughput of a phenotyping system. The goal of this work hence is to provide an effective and efficient tool for high-throughput plant counting from high-resolution RGB imagery. In contrast to conventional object detection, we encourage another promising paradigm termed object counting where plant counts are directly regressed from images, without detecting bounding boxes. In this work, by profiling the computational bottleneck, we implement a fast version of a state-of-the-art plant counting model TasselNetV2 with several minor yet effective modifications. We also provide insights why these modifications make sense. This fast version, TasselNetV2+, runs an order of magnitude faster than TasselNetV2, achieving around 30 fps on image resolution of 1980 × 1080, while it still retains the same level of counting accuracy. We validate its effectiveness on three plant counting tasks, including wheat ears counting, maize tassels counting, and sorghum heads counting. To encourage the use of this tool, our implementation has been made available online at https://tinyurl.com/TasselNetV2plus .

plant sciences

What problem does this paper attempt to address?

The main goal of this paper is to provide an effective and efficient tool for high-throughput plant counting from high-resolution RGB images. Specifically, the authors propose a new model named TasselNetV2+, which is an improvement over the previous TasselNetV2, aimed at enhancing processing speed while maintaining a similar level of counting accuracy.

The problems addressed by the paper include:
1. **Computational Efficiency Issue**: Existing plant counting methods (such as Faster R-CNN) have very high computational costs when processing high-resolution images, especially those captured by drones used in modern plant phenotyping platforms.
2. **Limitations of Traditional Plant Counting Methods**: Traditional manual counting methods are highly subjective, prone to errors, labor-intensive, and inefficient.
3. **Shortcomings of Existing Automated Counting Methods**: Although there have been attempts to use computer vision technology for automated counting, these methods are often limited by specific application scenarios or require high computational resources.

To address these issues, the authors propose TasselNetV2+, a fast-implemented plant counting model. Compared to the previous version TasselNetV2, TasselNetV2+ improves efficiency through the following ways:
- Improved the design of the counter and normalizer, particularly by mathematically rewriting the normalizer for equivalent but more efficient GPU implementation.
- Optimized the encoder, such as moving the position of the downsampling layer to increase the receptive field, allowing the network to capture more contextual information.
- Replaced the first convolutional layer in the counter with global average pooling, reducing the number of parameters while maintaining counting accuracy.

With these improvements, TasselNetV2+ can significantly enhance processing speed without sacrificing accuracy, making it suitable for high-throughput plant phenotyping systems.