Abstract:Abstract Background Grain yield of wheat is greatly associated with the population of wheat spikes, i.e., $$spike~number~\text {m}^{-2}$$spikenumberm-2. To obtain this index in a reliable and efficient way, it is necessary to count wheat spikes accurately and automatically. Currently computer vision technologies have shown great potential to automate this task effectively in a low-end manner. In particular, counting wheat spikes is a typical visual counting problem, which is substantially studied under the name of object counting in Computer Vision. TasselNet, which represents one of the state-of-the-art counting approaches, is a convolutional neural network-based local regression model, and currently benchmarks the best record on counting maize tassels. However, when applying TasselNet to wheat spikes, it cannot predict accurate counts when spikes partially present. Results In this paper, we make an important observation that the counting performance of local regression networks can be significantly improved via adding visual context to the local patches. Meanwhile, such context can be treated as part of the receptive field without increasing the model capacity. We thus propose a simple yet effective contextual extension of TasselNet—TasselNetv2. If implementing TasselNetv2 in a fully convolutional form, both training and inference can be greatly sped up by reducing redundant computations. In particular, we collected and labeled a large-scale wheat spikes counting (WSC) dataset, with 1764 high-resolution images and 675,322 manually-annotated instances. Extensive experiments show that, TasselNetv2 not only achieves state-of-the-art performance on the WSC dataset ($$91.01\%$$91.01% counting accuracy) but also is more than an order of magnitude faster than TasselNet (13.82 fps on $$912\times 1216$$912×1216 images). The generality of TasselNetv2 is further demonstrated by advancing the state of the art on both the Maize Tassels Counting and ShanghaiTech Crowd Counting datasets. Conclusions This paper describes TasselNetv2 for counting wheat spikes, which simultaneously addresses two important use cases in plant counting: improving the counting accuracy without increasing model capacity, and improving efficiency without sacrificing accuracy. It is promising to be deployed in a real-time system with high-throughput demand. In particular, TasselNetv2 can achieve sufficiently accurate results when training from scratch with small networks, and adopting larger pre-trained networks can further boost accuracy. In practice, one can trade off the performance and efficiency according to certain application scenarios. Code and models are made available at: https://tinyurl.com/TasselNetv2.

CSNet: A Count-Supervised Network via Multiscale MLP-Mixer for Wheat Ear Counting

CTHNet: a network for wheat ear counting with local-global features fusion based on hybrid architecture

WheatNet: A lightweight convolutional neural network for high-throughput image-based wheat head detection and counting

Wheat ear counting using K-means clustering segmentation and convolutional neural network

AuxSegCount: Auxiliary Seg-Attention Based Network for Wheat Ears Counting in Field Conditions

A Multiscale Point-Supervised Network for Counting Maize Tassels in the Wild

Wheat Head Counting by Estimating a Density Map with Convolutional Neural Networks

A density map-based method for counting wheat ears

LEVERAGE MULTI-SCALE DILATED CONVOLUTIONAL NEURAL NETWORK WITH GLOBAL ATTENTION FEATURE FUSION FOR CROWD COUNTING

TasselNetv2: In-Field Counting of Wheat Spikes with Context-Augmented Local Regression Networks

Segmentation and counting of wheat spike grains based on deep learning and textural feature

WheatLFANet: in-field detection and counting of wheat heads with high-real-time global regression network

Wheat Spike Detection and Counting in the Field Based on SpikeRetinaNet

Wheat-Net: An Automatic Dense Wheat Spike Segmentation Method Based on an Optimized Hybrid Task Cascade Model

IOCSegFormer: Enhancing Wheat Ears Counting in Field Conditions Through Augmented Local Features

Lightweight and efficient neural network with SPSA attention for wheat ear detection

Wheat ear detection based on FasterCANet-YOLOv8s algorithm

FIDMT-GhostNet: a lightweight density estimation model for wheat ear counting

A lightweight network for improving wheat ears detection and counting based on YOLOv5s

Occlusion Robust Wheat Ear Counting Algorithm Based on Deep Learning

Prediction and counting of field wheat based on LC-DcVgg