Abstract:Abstract Background Grain yield of wheat is greatly associated with the population of wheat spikes, i.e., $$spike~number~\text {m}^{-2}$$spikenumberm-2. To obtain this index in a reliable and efficient way, it is necessary to count wheat spikes accurately and automatically. Currently computer vision technologies have shown great potential to automate this task effectively in a low-end manner. In particular, counting wheat spikes is a typical visual counting problem, which is substantially studied under the name of object counting in Computer Vision. TasselNet, which represents one of the state-of-the-art counting approaches, is a convolutional neural network-based local regression model, and currently benchmarks the best record on counting maize tassels. However, when applying TasselNet to wheat spikes, it cannot predict accurate counts when spikes partially present. Results In this paper, we make an important observation that the counting performance of local regression networks can be significantly improved via adding visual context to the local patches. Meanwhile, such context can be treated as part of the receptive field without increasing the model capacity. We thus propose a simple yet effective contextual extension of TasselNet—TasselNetv2. If implementing TasselNetv2 in a fully convolutional form, both training and inference can be greatly sped up by reducing redundant computations. In particular, we collected and labeled a large-scale wheat spikes counting (WSC) dataset, with 1764 high-resolution images and 675,322 manually-annotated instances. Extensive experiments show that, TasselNetv2 not only achieves state-of-the-art performance on the WSC dataset ($$91.01\%$$91.01% counting accuracy) but also is more than an order of magnitude faster than TasselNet (13.82 fps on $$912\times 1216$$912×1216 images). The generality of TasselNetv2 is further demonstrated by advancing the state of the art on both the Maize Tassels Counting and ShanghaiTech Crowd Counting datasets. Conclusions This paper describes TasselNetv2 for counting wheat spikes, which simultaneously addresses two important use cases in plant counting: improving the counting accuracy without increasing model capacity, and improving efficiency without sacrificing accuracy. It is promising to be deployed in a real-time system with high-throughput demand. In particular, TasselNetv2 can achieve sufficiently accurate results when training from scratch with small networks, and adopting larger pre-trained networks can further boost accuracy. In practice, one can trade off the performance and efficiency according to certain application scenarios. Code and models are made available at: https://tinyurl.com/TasselNetv2.

WheatLFANet: in-field detection and counting of wheat heads with high-real-time global regression network

WheatNet: A lightweight convolutional neural network for high-throughput image-based wheat head detection and counting

MFNet: Multi-scale Feature Enhancement Networks for Wheat Head Detection and Counting in Complex Scene

TasselLFANet: a novel lightweight multi-branch feature aggregation neural network for high-throughput image-based maize tassels detection and counting

Generalized Focal Loss WheatNet (gflwheatnet): Accurate Application of a Wheat Ear Detection Model in Field Yield Prediction

A lightweight network for improving wheat ears detection and counting based on YOLOv5s

Wheat ear detection based on FasterCANet-YOLOv8s algorithm

Real-Time Detection for Wheat Head Applying Deep Neural Network.

TasselNetv2: In-Field Counting of Wheat Spikes with Context-Augmented Local Regression Networks

A Method for Wheat Head Detection Based on Yolov4

WheatNet: Attentional Path Aggregation Feature Pyramid Network for Precise Detection and Counting of Dense and Arbitrary-Oriented Wheat Spikes

CTHNet: a network for wheat ear counting with local-global features fusion based on hybrid architecture

Lightweight YOLOv8 for Wheat Head Detection

FIDMT-GhostNet: a lightweight density estimation model for wheat ear counting

High-Precision Wheat Head Detection Model Based on One-Stage Network and GAN Model

Improved YOLO-FastestV2 wheat spike detection model based on a multi-stage attention mechanism with a LightFPN detection head

Wheat-Net: An Automatic Dense Wheat Spike Segmentation Method Based on an Optimized Hybrid Task Cascade Model

A Lightweight Model Based on YOLOv8n in Wheat Spike Detection

SSRNet: In-Field Counting Wheat Ears Using Multi-Stage Convolutional Neural Network

Small and Oriented Wheat Spike Detection at the Filling and Maturity Stages Based on WheatNet

Lightweight and efficient neural network with SPSA attention for wheat ear detection