Virus antibodies in the serum of multiple sclerosis patients and matched controls.

J. Brody,J. Sever,T. E. Henson

IF: 9.9

1970-04-01

Neurology

Abstract:

What problem does this paper attempt to address?

Wheat Spike Detection and Counting in the Field Based on SpikeRetinaNet

Changji Wen,Jianshuang Wu,Hongrui Chen,Hengqiang Su,Xiao Chen,Zhuoshi Li,Ce Yang

DOI: https://doi.org/10.3389/fpls.2022.821717

IF: 5.6

2022-03-03

Frontiers in Plant Science

Abstract:The number of wheat spikes per unit area is one of the most important agronomic traits associated with wheat yield. However, quick and accurate detection for the counting of wheat spikes faces persistent challenges due to the complexity of wheat field conditions. This work has trained a RetinaNet (SpikeRetinaNet) based on several optimizations to detect and count wheat spikes efficiently. This RetinaNet consists of several improvements. First, a weighted bidirectional feature pyramid network (BiFPN) was introduced into the feature pyramid network (FPN) of RetinaNet, which could fuse multiscale features to recognize wheat spikes in different varieties and complicated environments. Then, to detect objects more efficiently, focal loss and attention modules were added. Finally, soft non-maximum suppression (Soft-NMS) was used to solve the occlusion problem. Based on these improvements, the new network detector was created and tested on the Global Wheat Head Detection (GWHD) dataset supplemented with wheat-wheatgrass spike detection (WSD) images. The WSD images were supplemented with new varieties of wheat, which makes the mixed dataset richer in species. The method of this study achieved 0.9262 for mAP50, which improved by 5.59, 49.06, 2.79, 1.35, and 7.26% compared to the state-of-the-art RetinaNet, single-shot multiBox detector (SSD), You Only Look Once version3 (Yolov3), You Only Look Once version4 (Yolov4), and faster region-based convolutional neural network (Faster-RCNN), respectively. In addition, the counting accuracy reached 0.9288, which was improved from other methods as well. Our implementation code and partial validation data are available at https://github.com/wujians122/The-Wheat-Spikes-Detecting-and-Counting .

plant sciences
Real-Time Detection and Counting of Wheat Spikes Based on Improved YOLOv10

Sitong Guan,Yiming Lin,Guoyu Lin,Peisen Su,Siluo Huang,Xianyong Meng,Pingzeng Liu,Jun Yan

DOI: https://doi.org/10.3390/agronomy14091936

2024-08-28

Agronomy

Abstract:Wheat is one of the most crucial food crops globally, with its yield directly impacting global food security. The accurate detection and counting of wheat spikes is essential for monitoring wheat growth, predicting yield, and managing fields. However, the current methods face challenges, such as spike size variation, shading, weed interference, and dense distribution. Conventional machine learning approaches have partially addressed these challenges, yet they are hampered by limited detection accuracy, complexities in feature extraction, and poor robustness under complex field conditions. In this paper, we propose an improved YOLOv10 algorithm that significantly enhances the model’s feature extraction and detection capabilities. This is achieved by introducing a bidirectional feature pyramid network (BiFPN), a separated and enhancement attention module (SEAM), and a global context network (GCNet). BiFPN leverages both top-down and bottom-up bidirectional paths to achieve multi-scale feature fusion, improving performance in detecting targets of various scales. SEAM enhances feature representation quality and model performance in complex environments by separately augmenting the attention mechanism for channel and spatial features. GCNet captures long-range dependencies in the image through the global context block, enabling the model to process complex information more accurately. The experimental results demonstrate that our method achieved a precision of 93.69%, a recall of 91.70%, and a mean average precision (mAP) of 95.10% in wheat spike detection, outperforming the benchmark YOLOv10 model by 2.02% in precision, 2.92% in recall, and 1.56% in mAP. Additionally, the coefficient of determination (R2) between the detected and manually counted wheat spikes was 0.96, with a mean absolute error (MAE) of 3.57 and a root-mean-square error (RMSE) of 4.09, indicating strong correlation and high accuracy. The improved YOLOv10 algorithm effectively solves the difficult problem of wheat spike detection under complex field conditions, providing strong support for agricultural production and research.

plant sciences,agronomy
Wheat-Net: An Automatic Dense Wheat Spike Segmentation Method Based on an Optimized Hybrid Task Cascade Model

Jiajing Zhang,An Min,Brian J. Steffenson,Wen-Hao Su,Cory D. Hirsch,James Anderson,Jian Wei,Qin Ma,Ce Yang

DOI: https://doi.org/10.3389/fpls.2022.834938

IF: 5.6

2022-02-10

Frontiers in Plant Science

Abstract:Precise segmentation of wheat spikes from a complex background is necessary for obtaining image-based phenotypic information of wheat traits such as yield estimation and spike morphology. A new instance segmentation method based on a Hybrid Task Cascade model was proposed to solve the wheat spike detection problem with improved detection results. In this study, wheat images were collected from fields where the environment varied both spatially and temporally. Res2Net50 was adopted as a backbone network, combined with multi-scale training, deformable convolutional networks, and Generic ROI Extractor for rich feature learning. The proposed methods were trained and validated, and the average precision (AP) obtained for the bounding box and mask was 0.904 and 0.907, respectively, and the accuracy for wheat spike counting was 99.29%. Comprehensive empirical analyses revealed that our method (Wheat-Net) performed well on challenging field-based datasets with mixed qualities, particularly those with various backgrounds and wheat spike adjacence/occlusion. These results provide evidence for dense wheat spike detection capabilities with masking, which is useful for not only wheat yield estimation but also spike morphology assessments.

plant sciences
Small and Oriented Wheat Spike Detection at the Filling and Maturity Stages Based on WheatNet

Jianqing Zhao,Yucheng Cai,Suwan Wang,Jiawei Yan,Xiaolei Qiu,Xia Yao,Yongchao Tian,Yan Zhu,Weixing Cao,Xiaohu Zhang

DOI: https://doi.org/10.34133/plantphenomics.0109

IF: 6.961

2023-01-01

Plant Phenomics

Abstract:Accurate wheat spike detection is crucial in wheat field phenotyping for precision farming. Advances in artificial intelligence have enabled deep learning models to improve the accuracy of detecting wheat spikes. However, wheat growth is a dynamic process characterized by important changes in the color feature of wheat spikes and the background. Existing models for wheat spike detection are typically designed for a specific growth stage. Their adaptability to other growth stages or field scenes is limited. Such models cannot detect wheat spikes accurately caused by the difference in color, size, and morphological features between growth stages. This paper proposes WheatNet to detect small and oriented wheat spikes from the filling to the maturity stage. WheatNet constructs a Transform Network to reduce the effect of differences in the color features of spikes at the filling and maturity stages on detection accuracy. Moreover, a Detection Network is designed to improve wheat spike detection capability. A Circle Smooth Label is proposed to classify wheat spike angles in drone imagery. A new micro-scale detection layer is added to the network to extract the features of small spikes. Localization loss is improved by Complete Intersection over Union to reduce the impact of the background. The results show that WheatNet can achieve greater accuracy than classical detection methods. The detection accuracy with average precision of spike detection at the filling stage is 90.1%, while it is 88.6% at the maturity stage. It suggests that WheatNet is a promising tool for detection of wheat spikes.

plant sciences,agronomy,remote sensing
WheatSpikeNet: an improved wheat spike segmentation model for accurate estimation from field imaging

M A Batin,Muhaiminul Islam,Md Mehedi Hasan,Akm Azad,Salem A Alyami,Md Azam Hossain,Stanley J Miklavcic

DOI: https://doi.org/10.3389/fpls.2023.1226190

2023-08-25

Abstract:Phenotyping is used in plant breeding to identify genotypes with desirable characteristics, such as drought tolerance, disease resistance, and high-yield potentials. It may also be used to evaluate the effect of environmental circumstances, such as drought, heat, and salt, on plant growth and development. Wheat spike density measure is one of the most important agronomic factors relating to wheat phenotyping. Nonetheless, due to the diversity of wheat field environments, fast and accurate identification for counting wheat spikes remains one of the challenges. This study proposes a meticulously curated and annotated dataset, named as SPIKE-segm, taken from the publicly accessible SPIKE dataset, and an optimal instance segmentation approach named as WheatSpikeNet for segmenting and counting wheat spikes from field imagery. The proposed method is based on the well-known Cascade Mask RCNN architecture with model enhancements and hyperparameter tuning to provide state-of-the-art detection and segmentation performance. A comprehensive ablation analysis incorporating many architectural components of the model was performed to determine the most efficient version. In addition, the model's hyperparameters were fine-tuned by conducting several empirical tests. ResNet50 with Deformable Convolution Network (DCN) as the backbone architecture for feature extraction, Generic RoI Extractor (GRoIE) for RoI pooling, and Side Aware Boundary Localization (SABL) for wheat spike localization comprises the final instance segmentation model. With bbox and mask mean average precision (mAP) scores of 0.9303 and 0.9416, respectively, on the test set, the proposed model achieved superior performance on the challenging SPIKE datasets. Furthermore, in comparison with other existing state-of-the-art methods, the proposed model achieved up to a 0.41% improvement of mAP in spike detection and a significant improvement of 3.46% of mAP in the segmentation tasks that will lead us to an appropriate yield estimation from wheat plants.
Detection method of wheat spike improved YOLOv5s based on the attention mechanism

Hecang Zang,Yanjing Wang,Linyuan Ru,Meng Zhou,Dandan Chen,Qing Zhao,Jie Zhang,Guoqiang Li,Guoqing Zheng

DOI: https://doi.org/10.3389/fpls.2022.993244

IF: 5.6

2022-09-29

Frontiers in Plant Science

Abstract:In wheat breeding, spike number is a key indicator for evaluating wheat yield, and the timely and accurate acquisition of wheat spike number is of great practical significance for yield prediction. In actual production; the method of using an artificial field survey to count wheat spikes is time-consuming and labor-intensive. Therefore, this paper proposes a method based on YOLOv5s with an improved attention mechanism, which can accurately detect the number of small-scale wheat spikes and better solve the problems of occlusion and cross-overlapping of the wheat spikes. This method introduces an efficient channel attention module (ECA) in the C3 module of the backbone structure of the YOLOv5s network model; at the same time, the global attention mechanism module (GAM) is inserted between the neck structure and the head structure; the attention mechanism can be more Effectively extract feature information and suppress useless information. The result shows that the accuracy of the improved YOLOv5s model reached 71.61% in the task of wheat spike number, which was 4.95% higher than that of the standard YOLOv5s model and had higher counting accuracy. The improved YOLOv5s and YOLOv5m have similar parameters, while RMSE and MEA are reduced by 7.62 and 6.47, respectively, and the performance is better than YOLOv5l. Therefore, the improved YOLOv5s method improves its applicability in complex field environments and provides a technical reference for the automatic identification of wheat spike numbers and yield estimation. Labeled images, source code, and trained models are available at: https://github.com/228384274/improved-yolov5.

plant sciences
Automatic detection and counting of wheat spike based on DMseg-Count

Hecang Zang,Yilong Peng,Meng Zhou,Guoqiang Li,Guoqing Zheng,Hualei Shen

DOI: https://doi.org/10.1038/s41598-024-80244-1

IF: 4.6

2024-12-01

Scientific Reports

Abstract:The automatic detection and counting of wheat spike images are of great significance for yield prediction and variety evaluation. Therefore, accurate and timely estimation of spike numbers is crucial for wheat production. However, in actual production, due to the susceptibility of wheat spike images to factors such as lighting conditions, shooting angles, occlusion, and overlap, the contour and features of wheat spike is unclear, which affects the accuracy of automatic detection and counting of wheat spike. In order to solve the above problems and further improve the accuracy of wheat spike counting, an improved wheat spike counting model DMseg-Count was proposed by enhancing local contextual supervision information based on existing target object counting model DM-Count. Firstly, wheat spike local segmentation branch was introduced to improve the network architecture of DM-Count, so as to extract the local contextual supervision information of wheat spike. Secondly, an element-by-element point multiplication mechanism was designed to fuse global and local contextual supervision information of wheat spike. Finally, the total loss function was constructed to optimize the model. The test results showed that the mean absolute error (MAE) and root mean square error (RMSE) of the proposed DMseg-Count model were 5.79 and 7.54, respectively, which were 9.76 and 10.91 higher than the standard distribution matching for crowd counting (DM-Count) model. Compared with other deep learning models, the proposed DMseg-Count model can detect wheat spike image in challenging situations, and has better computer vision processing capabilities and performance evaluation detection effect. In summary, the proposed DMseg-Count model can effectively detect wheat spike and has good counting performance, which provides a new method for automatic counting of wheat spike and yield prediction in complex field environments.

multidisciplinary sciences
Improved YOLO-FastestV2 wheat spike detection model based on a multi-stage attention mechanism with a LightFPN detection head

Shunhao Qing,Zhaomei Qiu,Weili Wang,Fei Wang,Xin Jin,Jiangtao Ji,Long Zhao,Yi Shi

DOI: https://doi.org/10.3389/fpls.2024.1411510

IF: 5.6

2024-06-19

Frontiers in Plant Science

Abstract:The number of wheat spikes has an important influence on wheat yield, and the rapid and accurate detection of wheat spike numbers is of great significance for wheat yield estimation and food security. Computer vision and machine learning have been widely studied as potential alternatives to human detection. However, models with high accuracy are computationally intensive and time consuming, and lightweight models tend to have lower precision. To address these concerns, YOLO-FastestV2 was selected as the base model for the comprehensive study and analysis of wheat sheaf detection. In this study, we constructed a wheat target detection dataset comprising 11,451 images and 496,974 bounding boxes. The dataset for this study was constructed based on the Global Wheat Detection Dataset and the Wheat Sheaf Detection Dataset, which was published by PP Flying Paddle. We selected three attention mechanisms, Large Separable Kernel Attention (LSKA), Efficient Channel Attention (ECA), and Efficient Multi-Scale Attention (EMA), to enhance the feature extraction capability of the backbone network and improve the accuracy of the underlying model. First, the attention mechanism was added after the base and output phases of the backbone network. Second, the attention mechanism that further improved the model accuracy after the base and output phases was selected to construct the model with a two-phase added attention mechanism. On the other hand, we constructed SimLightFPN to improve the model accuracy by introducing SimConv to improve the LightFPN module. The results of the study showed that the YOLO-FastestV2-SimLightFPN-ECA-EMA hybrid model, which incorporates the ECA attention mechanism in the base stage and introduces the EMA attention mechanism and the combination of SimLightFPN modules in the output stage, has the best overall performance. The accuracy of the model was P=83.91%, R=78.35%, AP= 81.52%, and F1 = 81.03%, and it ranked first in the GPI (0.84) in the overall evaluation. The research examines the deployment of wheat ear detection and counting models on devices with constrained resources, delivering novel solutions for the evolution of agricultural automation and precision agriculture.

plant sciences
A Wheat Spike Detection Method in UAV Images Based on Improved YOLOv5

Jianqing Zhao,Xiaohu Zhang,Jiawei Yan,Xiaolei Qiu,Xia Yao,Yongchao Tian,Yan Zhu,Weixing Cao

DOI: https://doi.org/10.3390/rs13163095

IF: 5

2021-08-05

Remote Sensing

Abstract:Deep-learning-based object detection algorithms have significantly improved the performance of wheat spike detection. However, UAV images crowned with small-sized, highly dense, and overlapping spikes cause the accuracy to decrease for detection. This paper proposes an improved YOLOv5 (You Look Only Once)-based method to detect wheat spikes accurately in UAV images and solve spike error detection and miss detection caused by occlusion conditions. The proposed method introduces data cleaning and data augmentation to improve the generalization ability of the detection network. The network is rebuilt by adding a microscale detection layer, setting prior anchor boxes, and adapting the confidence loss function of the detection layer based on the IoU (Intersection over Union). These refinements improve the feature extraction for small-sized wheat spikes and lead to better detection accuracy. With the confidence weights, the detection boxes in multiresolution images are fused to increase the accuracy under occlusion conditions. The result shows that the proposed method is better than the existing object detection algorithms, such as Faster RCNN, Single Shot MultiBox Detector (SSD), RetinaNet, and standard YOLOv5. The average accuracy (AP) of wheat spike detection in UAV images is 94.1%, which is 10.8% higher than the standard YOLOv5. Thus, the proposed method is a practical way to handle the spike detection in complex field scenarios and provide technical references for field-level wheat phenotype monitoring.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
TasselNetv2: In-Field Counting of Wheat Spikes with Context-Augmented Local Regression Networks

Haipeng Xiong,Zhiguo Cao,Hao Lu,Simon Madec,Liang Liu,Chunhua Shen

DOI: https://doi.org/10.1186/s13007-019-0537-2

IF: 5.827

2019-01-01

Plant Methods

Abstract:Abstract Background Grain yield of wheat is greatly associated with the population of wheat spikes, i.e., $$spike~number~\text {m}^{-2}$$spikenumberm-2. To obtain this index in a reliable and efficient way, it is necessary to count wheat spikes accurately and automatically. Currently computer vision technologies have shown great potential to automate this task effectively in a low-end manner. In particular, counting wheat spikes is a typical visual counting problem, which is substantially studied under the name of object counting in Computer Vision. TasselNet, which represents one of the state-of-the-art counting approaches, is a convolutional neural network-based local regression model, and currently benchmarks the best record on counting maize tassels. However, when applying TasselNet to wheat spikes, it cannot predict accurate counts when spikes partially present. Results In this paper, we make an important observation that the counting performance of local regression networks can be significantly improved via adding visual context to the local patches. Meanwhile, such context can be treated as part of the receptive field without increasing the model capacity. We thus propose a simple yet effective contextual extension of TasselNet—TasselNetv2. If implementing TasselNetv2 in a fully convolutional form, both training and inference can be greatly sped up by reducing redundant computations. In particular, we collected and labeled a large-scale wheat spikes counting (WSC) dataset, with 1764 high-resolution images and 675,322 manually-annotated instances. Extensive experiments show that, TasselNetv2 not only achieves state-of-the-art performance on the WSC dataset ($$91.01\%$$91.01% counting accuracy) but also is more than an order of magnitude faster than TasselNet (13.82 fps on $$912\times 1216$$912×1216 images). The generality of TasselNetv2 is further demonstrated by advancing the state of the art on both the Maize Tassels Counting and ShanghaiTech Crowd Counting datasets. Conclusions This paper describes TasselNetv2 for counting wheat spikes, which simultaneously addresses two important use cases in plant counting: improving the counting accuracy without increasing model capacity, and improving efficiency without sacrificing accuracy. It is promising to be deployed in a real-time system with high-throughput demand. In particular, TasselNetv2 can achieve sufficiently accurate results when training from scratch with small networks, and adopting larger pre-trained networks can further boost accuracy. In practice, one can trade off the performance and efficiency according to certain application scenarios. Code and models are made available at: https://tinyurl.com/TasselNetv2.
A wheat spike detection method based on Transformer

Qiong Zhou,Ziliang Huang,Shijian Zheng,Lin Jiao,Liusan Wang,Rujing Wang

DOI: https://doi.org/10.3389/fpls.2022.1023924

IF: 5.6

2022-10-21

Frontiers in Plant Science

Abstract:Wheat spike detection has important research significance for production estimation and crop field management. With the development of deep learning-based algorithms, researchers tend to solve the detection task by convolutional neural networks (CNNs). However, traditional CNNs equip with the inductive bias of locality and scale-invariance, which makes it hard to extract global and long-range dependency. In this paper, we propose a Transformer-based network named Multi-Window Swin Transformer (MW-Swin Transformer). Technically, MW-Swin Transformer introduces the ability of feature pyramid network to extract multi-scale features and inherits the characteristic of Swin Transformer that performs self-attention mechanism by window strategy. Moreover, bounding box regression is a crucial step in detection. We propose a Wheat Intersection over Union loss by incorporating the Euclidean distance, area overlapping, and aspect ratio, thereby leading to better detection accuracy. We merge the proposed network and regression loss into a popular detection architecture, fully convolutional one-stage object detection, and name the unified model WheatFormer. Finally, we construct a wheat spike detection dataset (WSD-2022) to evaluate the performance of the proposed methods. The experimental results show that the proposed network outperforms those state-of-the-art algorithms with 0.459 mAP (mean average precision) and 0.918 AP 50 . It has been proved that our Transformer-based method is effective to handle wheat spike detection under complex field conditions.

plant sciences
Prediction and counting of field wheat based on LC-DcVgg

Zhang Yiwen,Shu Baiyi,Xue Ziwei,Wang Yue,Mu Jiong

DOI: https://doi.org/10.1145/3395260.3395299

2020-04-10

Abstract:The number of wheat spikes per unit area is an important parameter for assessing wheat yield and wheat planting density. At present, the methods of intelligent counting of wheat include remote sensing technology and machine learning technology, but all have shortcomings such as poor stability, strong limitations, and poor versatility. And however, the existing object detection neural network algorithm requires a large amount of manpower to produce data sets. And it is not possible to identify too dense wheat spikes. In this paper, a new structure called direct connection is proposed to improve the algorithm of Vggnet, which makes it better combined with localization-based counting loss. Direct connection can fuse the features of shallow layer with those of deep layers, which can make the network retain the original picture information and make the localization-based counting loss play a better role in wheat spike counting. The model has a good recognition effect on the wheat spikes that are stuck together. For dense wheat spikes, the model can achieve MAE of 11.857, an accuracy rate of 90.4%, RMSE of 16.985.
Improving multi-scale detection layers in the deep learning network for wheat spike detection based on interpretive analysis

DOI: https://doi.org/10.1186/s13007-023-01020-2

IF: 5.827

2023-05-14

Plant Methods

Abstract:Detecting and counting wheat spikes is essential for predicting and measuring wheat yield. However, current wheat spike detection researches often directly apply the new network structure. There are few studies that can combine the prior knowledge of wheat spike size characteristics to design a suitable wheat spike detection model. It remains unclear whether the complex detection layers of the network play their intended role.

plant sciences,biochemical research methods
Feature diffusion reconstruction mechanism network for crop spike head detection

Rui Ming,Qian Gong,Chen Yang,Haibo Luo,Cancan Song,Zhiyan Zhou

DOI: https://doi.org/10.3389/fpls.2024.1459515

2024-10-01

Abstract:Introduction: Monitoring crop spike growth using low-altitude remote sensing images is essential for precision agriculture, as it enables accurate crop health assessment and yield estimation. Despite the advancements in deep learning-based visual recognition, existing crop spike detection methods struggle to balance computational efficiency with accuracy in complex multi-scale environments, particularly on resource-constrained low-altitude remote sensing platforms. Methods: To address this gap, we propose FDRMNet, a novel feature diffusion reconstruction mechanism network designed to accurately detect crop spikes in challenging scenarios. The core innovation of FDRMNet lies in its multi-scale feature focus reconstruction and lightweight parameter-sharing detection head, which can effectively improve the computational efficiency of the model while enhancing the model's ability to perceive spike shape and texture.FDRMNet introduces a Multi-Scale Feature Focus Reconstruction module that integrates feature information across different scales and employs various convolutional kernels to capture global context effectively. Additionally, an Attention-Enhanced Feature Fusion Module is developed to improve the interaction between different feature map positions, leveraging adaptive average pooling and convolution operations to enhance the model's focus on critical features. To ensure suitability for low-altitude platforms with limited computational resources, we incorporate a Lightweight Parameter Sharing Detection Head, which reduces the model's parameter count by sharing weights across convolutional layers. Results: According to the evaluation experiments on the global wheat head detection dataset and diverse rice panicle detection dataset, FDRMNet outperforms other state-of-the-art methods with mAP@.5 of 94.23%, 75.13% and R 2 value of 0.969, 0.963 between predicted values and ground truth values. In addition, the model's frames per second and parameters in the two datasets are 227.27,288 and 6.8M, respectively, which maintains the top three position among all the compared algorithms. Discussion: Extensive qualitative and quantitative experiments demonstrate that FDRMNet significantly outperforms existing methods in spike detection and counting tasks, achieving higher detection accuracy with lower computational complexity.The results underscore the model's superior practicality and generalization capability in real-world applications. This research contributes a highly efficient and computationally effective solution for crop spike detection, offering substantial benefits to precision agriculture practices.
Automatic Detection and Counting of Wheat Spikelet Using Semi-Automatic Labeling and Deep Learning

Ruicheng Qiu,Yong He,Man Zhang

DOI: https://doi.org/10.3389/fpls.2022.872555

IF: 5.6

2022-05-31

Frontiers in Plant Science

Abstract:The number of wheat spikelets is an important phenotypic trait and can be used to assess the grain yield of the wheat crop. However, manual counting of spikelets is time-consuming and labor-intensive. To develop a cost-effective and highly efficient phenotyping system for counting the number of spikelets under laboratory conditions, methods based on imaging processing techniques and deep learning were proposed to accurately detect and count spikelets from color images of wheat spikes captured at the grain filling stage. An unsupervised learning-based method was first developed to automatically detect and label spikelets from spike color images and build the datasets for the model training. Based on the constructed datasets, a deep convolutional neural network model was retrained using transfer learning to detect the spikelets. Testing results showed that the root mean squared errors, relative root mean squared errors, and the coefficients of determination between the automatic and manual counted spikelets for four wheat lines were 0.62, 0.58, 0.54, and 0.77; 3.96, 3.73, 3.34, and 4.94%; and 0.73, 0.78, 0.84, and 0.67, respectively. We demonstrated that the proposed methods can effectively estimate the number of wheat spikelets, which improves the counting efficiency of wheat spikelets and contributes to the analysis of the developmental characteristics of wheat spikes.

plant sciences
Rapid Recognition of Field-Grown Wheat Spikes Based on a Superpixel Segmentation Algorithm Using Digital Images

Changwei Tan,Pengpeng Zhang,Yongjiang Zhang,Xinxing Zhou,Zhixiang Wang,Ying Du,Wei Mao,Wenxi Li,Dunliang Wang,Wenshan Guo

DOI: https://doi.org/10.3389/fpls.2020.00259

IF: 5.6

2020-03-06

Frontiers in Plant Science

Abstract:Wheat spike number, which could be rapidly and accurately estimated by the image processing technology, serves as the basis for crop growth monitoring and yield prediction. In this research, simple linear iterative clustering (SLIC) was performed for superpixel segmentation of the digital images of field-grown wheat. Firstly, certain characteristic color parameters were extracted and analyzed from the digital images, and the classifiers with the highest accuracy were chosen for subsequent image classification. Next, the main body of wheat spike was extracted through a series of morphological transformation and estimate was performed for each region. Backbone of the head was extracted, and the number of inflection points of backbone was detected. Then the wheat spike number was determined by combining the estimate of inflection points of backbone and the estimate for each region. Finally, the wheat spike number estimate was verified under four nitrogen fertilizer levels. The results were as follows: (1) Super green value (Eg) and normalized red green index (Dgr) were used as classification features to recognize wheat spikes, soil and leaves; (2) compared with pixel-based image processing, wheat spike recognition effect was much better after superpixel segmentation, as the main body of wheat spike extracted was more clear and morphology more intact; and (3) wheat plants had better growth under high nitrogen fertilizer level, and the accuracy of wheat spike number estimation was also the highest, which was 94.01%. The growth status was the worst under no nitrogen fertilizer application, and the accuracy of wheat spikes number estimation was also the lowest, which was only 80.8%. After excluding the no nitrogen condition, the accuracy of wheat spikes number estimation among mixed samples with more uniform growth status was up to 93.8%, which was an increase by 10.1% than before the exclusion. Wheat spikes number estimate based on superpixel segmentation and color features was a rapid and accurate method that was applicable to the field environment. However, this method was not recommended for use when the growth status of wheat was poor or of high heterogeneity. The findings provided reference for field-grown wheat yield estimate.

plant sciences
Segmentation and counting of wheat spike grains based on deep learning and textural feature

Xin Xu,Qing Geng,Feng Gao,Du Xiong,Hongbo Qiao,Xinming Ma

DOI: https://doi.org/10.1186/s13007-023-01062-6

IF: 5.827

2023-08-01

Plant Methods

Abstract:Background: Grain count is crucial to wheat yield composition and estimating yield parameters. However, traditional manual counting methods are time-consuming and labor-intensive. This study developed an advanced deep learning technique for the segmentation counting model of wheat grains. This model has been rigorously tested on three distinct wheat varieties: 'Bainong 307', 'Xinmai 26', and 'Jimai 336', and it has achieved unprecedented predictive counting accuracy. Method: The images of wheat ears were taken with a smartphone at the late stage of wheat grain filling. We used image processing technology to preprocess and normalize the images to 480*480 pixels. A CBAM-HRNet wheat grain segmentation counting deep learning model based on the Convolutional Block Attention Module (CBAM) was constructed by combining deep learning, migration learning, and attention mechanism. Image processing algorithms and wheat grain texture features were used to build a grain counting and predictive counting model for wheat grains. Results: The CBAM-HRNet model using the CBAM was the best for wheat grain segmentation. Its segmentation accuracy of 92.04%, the mean Intersection over Union (mIoU) of 85.21%, the category mean pixel accuracy (mPA) of 91.16%, and the recall rate of 91.16% demonstrate superior robustness compared to other models such as HRNet, PSPNet, DeeplabV3+ , and U-Net. Method I for spike count, which calculates twice the number of grains on one side of the spike to determine the total number of grains, demonstrates a coefficient of determination R2 of 0.85, a mean absolute error (MAE) of 1.53, and a mean relative error (MRE) of 2.91. In contrast, Method II for spike count involves summing the number of grains on both sides to determine the total number of grains, demonstrating a coefficient of determination R2 of 0.92, an MAE) of 1.15, and an MRE) of 2.09%. Conclusions: Image segmentation algorithm of the CBAM-HRNet wheat spike grain is a powerful solution that uses the CBAM to segment wheat spike grains and obtain richer semantic information. This model can effectively address the challenges of small target image segmentation and under-fitting problems in training. Additionally, the spike grain counting model can quickly and accurately predict the grain count of wheat, providing algorithmic support for efficient and intelligent wheat yield estimation.
From Fields to Pixels: UAV Multispectral and Field-Captured RGB Imaging for High-Throughput Wheat Spike and Kernel Counting

Ahmed Mohammed,Nisar Ali,Abdul Bais,Yuefeng Ruan,Richard D. Cuthbert,Jatinder S. Sangha

DOI: https://doi.org/10.1109/jstars.2024.3463432

IF: 4.715

2024-10-11

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:Wheat breeding enhances wheat crops for better environmental resistance and higher yield potential. Experimental breeding lines are evaluated based on their yield potential, where quantifying spikes per unit area and kernels per spike is crucial for assessment. This study introduces SPINEL (SPIke and kerNEL), a framework that combines unmanned aerial vehicle (UAV)-captured multispectral imaging and field-captured RGB camera imaging for spike and kernel quantification. This approach utilizes YOLOv8 models, each tailored for a specific detection task. The first model detects plots in UAV-captured multispectral images with a mean average precision (mAP) score of 95%, while the second model, trained to detect spikes in the same dataset, demonstrates an mAP score of 86%. The third model detects spikes and kernels in field-captured RGB images with an 85% mAP score. The first two models aid in estimating the spike density in each field plot. The third model provides the estimated number of kernels in spikes of each unique breeding line. Spikes per field plot and kernels per spike serve as key quantification metrics. The SPINEL framework utilizes the geolocation information of the multispectral images and associates these metrics with breeding lines at the field level. This integration provides a clear visual representation of spike count and average kernels per spike for each field plot. SPINEL offers a precise, automated solution for phenotyping in wheat breeding, promising significant advancements in crop improvement strategies.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geography, physical
High-throughput spike detection in greenhouse cultivated grain crops with attention mechanisms based deep learning models

Sajid Ullah,Klára Panzarová,Martin Trtílek,Matej Lexa,Vojtěch Máčala,Kerstin Neumann,Thomas Altmann,Jan Hejátko,Markéta Pernisová,Evgeny Gladilin,Jan Hejatko

DOI: https://doi.org/10.34133/plantphenomics.0155

IF: 6.961

2024-02-12

Plant Phenomics

Abstract:Detection of spikes is the first important step toward image-based quantitative assessment of crop yield. However, spikes of grain plants occupy only a tiny fraction of the image area and often emerge in the middle of the mass of plant leaves that exhibit similar colors to spike regions. Consequently, accurate detection of grain spikes renders, in general, a non-trivial task even for advanced, state-of-the-art deep neural networks (DNNs). To improve pattern detection in spikes, we propose architectural changes to Faster-RCNN (FRCNN) by reducing feature extraction layers and introducing a global attention module. The performance of our extended FRCNN-A vs. conventional FRCNN was compared on images of different European wheat cultivars, including "difficult" bushy phenotypes from 2 different phenotyping facilities and optical setups. Our experimental results show that introduced architectural adaptations in FRCNN-A helped to improve spike detection accuracy in inner regions. The mean average precision (mAP) of FRCNN and FRCNN-A on inner spikes is 76.0% and 81.0%, respectively, while on the state-of-the-art detection DNNs, Swin Transformer mAP is 83.0%. As a lightweight network, FRCNN-A is faster than FRCNN and Swin Transformer on both baseline and augmented training datasets. On the FastGAN augmented dataset, FRCNN achieved a mAP of 84.24%, FRCNN-A attained a mAP of 85.0%, and the Swin Transformer achieved a mAP of 89.45%. The increase in mAP of DNNs on the augmented datasets is proportional to the amount of the IPK original and augmented images. Overall, this study indicates a superior performance of attention mechanisms-based deep learning models in detecting small and subtle features of grain spikes.

plant sciences,agronomy,remote sensing
A Deep Learning Method for Oriented and Small Wheat Spike Detection (oswsdet) in UAV Images

Jianqing Zhao,Jiawei Yan,Tianjie Xue,Suwan Wang,Xiaolei Qiu,Xia Yao,Yongchao Tian,Yan Zhu,Weixing Cao,Xiaohu Zhang

DOI: https://doi.org/10.1016/j.compag.2022.107087

IF: 8.3

2022-01-01

Computers and Electronics in Agriculture

Abstract:Detecting and characterizing spikes from wheat field images is essential in wheat growth monitoring for precision farming. Along with various technological developments, deep-learning-based methods have remarkably improved wheat spike detection performance. However, detecting small and overlapping wheat spikes in UAV images is still challenging because high spike occlusion and complex background can cause error detection and miss detection problems. This paper proposes a deep learning method for oriented and small wheat spike detection (OSWSDet). Unlike classical wheat spike detection methods, OSWSDet introduces the orientation of wheat spikes into the YOLO framework by integrating a circle smooth label (CSL) and a micro-scale detection layer. These improvements enhance the ability to detect small-sized wheat spikes and prevent wheat spike detection errors. The experiment results show that OSWSDet outperforms classical wheat spike detection methods, and the average accuracy (AP) is 90.5%. OSWSDet can accurately detect spikes in UAV images with complex field backgrounds and provides technical references for future field wheat phenotype monitoring.

Virus antibodies in the serum of multiple sclerosis patients and matched controls.

Wheat Spike Detection and Counting in the Field Based on SpikeRetinaNet

Real-Time Detection and Counting of Wheat Spikes Based on Improved YOLOv10

Wheat-Net: An Automatic Dense Wheat Spike Segmentation Method Based on an Optimized Hybrid Task Cascade Model

Small and Oriented Wheat Spike Detection at the Filling and Maturity Stages Based on WheatNet

WheatSpikeNet: an improved wheat spike segmentation model for accurate estimation from field imaging

Detection method of wheat spike improved YOLOv5s based on the attention mechanism

Automatic detection and counting of wheat spike based on DMseg-Count

Improved YOLO-FastestV2 wheat spike detection model based on a multi-stage attention mechanism with a LightFPN detection head

A Wheat Spike Detection Method in UAV Images Based on Improved YOLOv5

TasselNetv2: In-Field Counting of Wheat Spikes with Context-Augmented Local Regression Networks

A wheat spike detection method based on Transformer

Prediction and counting of field wheat based on LC-DcVgg

Improving multi-scale detection layers in the deep learning network for wheat spike detection based on interpretive analysis

Feature diffusion reconstruction mechanism network for crop spike head detection

Automatic Detection and Counting of Wheat Spikelet Using Semi-Automatic Labeling and Deep Learning

Rapid Recognition of Field-Grown Wheat Spikes Based on a Superpixel Segmentation Algorithm Using Digital Images

Segmentation and counting of wheat spike grains based on deep learning and textural feature

From Fields to Pixels: UAV Multispectral and Field-Captured RGB Imaging for High-Throughput Wheat Spike and Kernel Counting

High-throughput spike detection in greenhouse cultivated grain crops with attention mechanisms based deep learning models

A Deep Learning Method for Oriented and Small Wheat Spike Detection (oswsdet) in UAV Images