Abstract:Abstract Background Grain yield of wheat is greatly associated with the population of wheat spikes, i.e., $$spike~number~\text {m}^{-2}$$spikenumberm-2. To obtain this index in a reliable and efficient way, it is necessary to count wheat spikes accurately and automatically. Currently computer vision technologies have shown great potential to automate this task effectively in a low-end manner. In particular, counting wheat spikes is a typical visual counting problem, which is substantially studied under the name of object counting in Computer Vision. TasselNet, which represents one of the state-of-the-art counting approaches, is a convolutional neural network-based local regression model, and currently benchmarks the best record on counting maize tassels. However, when applying TasselNet to wheat spikes, it cannot predict accurate counts when spikes partially present. Results In this paper, we make an important observation that the counting performance of local regression networks can be significantly improved via adding visual context to the local patches. Meanwhile, such context can be treated as part of the receptive field without increasing the model capacity. We thus propose a simple yet effective contextual extension of TasselNet—TasselNetv2. If implementing TasselNetv2 in a fully convolutional form, both training and inference can be greatly sped up by reducing redundant computations. In particular, we collected and labeled a large-scale wheat spikes counting (WSC) dataset, with 1764 high-resolution images and 675,322 manually-annotated instances. Extensive experiments show that, TasselNetv2 not only achieves state-of-the-art performance on the WSC dataset ($$91.01\%$$91.01% counting accuracy) but also is more than an order of magnitude faster than TasselNet (13.82 fps on $$912\times 1216$$912×1216 images). The generality of TasselNetv2 is further demonstrated by advancing the state of the art on both the Maize Tassels Counting and ShanghaiTech Crowd Counting datasets. Conclusions This paper describes TasselNetv2 for counting wheat spikes, which simultaneously addresses two important use cases in plant counting: improving the counting accuracy without increasing model capacity, and improving efficiency without sacrificing accuracy. It is promising to be deployed in a real-time system with high-throughput demand. In particular, TasselNetv2 can achieve sufficiently accurate results when training from scratch with small networks, and adopting larger pre-trained networks can further boost accuracy. In practice, one can trade off the performance and efficiency according to certain application scenarios. Code and models are made available at: https://tinyurl.com/TasselNetv2.

Prediction and counting of field wheat based on LC-DcVgg

Automatic detection and counting of wheat spike based on DMseg-Count

Segmentation and counting of wheat spike grains based on deep learning and textural feature

TasselNetv2: In-Field Counting of Wheat Spikes with Context-Augmented Local Regression Networks

Real-Time Detection and Counting of Wheat Spikes Based on Improved YOLOv10

A generalized model for accurate wheat spike detection and counting in complex scenarios

Wheat Spike Detection and Counting in the Field Based on SpikeRetinaNet

WheatNet: A lightweight convolutional neural network for high-throughput image-based wheat head detection and counting

Automatic Detection and Counting of Wheat Spikelet Using Semi-Automatic Labeling and Deep Learning

Small and Oriented Wheat Spike Detection at the Filling and Maturity Stages Based on WheatNet

Wheat Head Counting by Estimating a Density Map with Convolutional Neural Networks

WheatLFANet: in-field detection and counting of wheat heads with high-real-time global regression network

FIDMT-GhostNet: a lightweight density estimation model for wheat ear counting

A wheat spike detection method based on Transformer

Improved YOLO-FastestV2 wheat spike detection model based on a multi-stage attention mechanism with a LightFPN detection head

Wheat ear counting using K-means clustering segmentation and convolutional neural network

Occlusion Robust Wheat Ear Counting Algorithm Based on Deep Learning

Detection method of wheat spike improved YOLOv5s based on the attention mechanism

Winter wheat ear counting based on improved YOLOv7x and Kalman filter tracking algorithm with video streaming

Wheat-Net: An Automatic Dense Wheat Spike Segmentation Method Based on an Optimized Hybrid Task Cascade Model

Development of image-based wheat spike counter through a Faster R-CNN algorithm and application for genetic studies