Abstract:Introduction: The precise detection of weeds in the field is the premise of implementing weed management. However, the similar color, morphology, and occlusion between wheat and weeds pose a challenge to the detection of weeds. In this study, a CSCW-YOLOv7 based on an improved YOLOv7 architecture was proposed to identify five types of weeds in complex wheat fields. Methods: First, a dataset was constructed for five weeds that are commonly found, namely, Descurainia sophia , thistle, golden saxifrage, shepherd's purse herb, and Artemisia argyi . Second, a wheat weed detection model called CSCW-YOLOv7 was proposed to achieve the accurate identification and classification of wheat weeds. In the CSCW-YOLOv7, the CARAFE operator was introduced as an up-sampling algorithm to improve the recognition of small targets. Then, the Squeeze-and-Excitation (SE) network was added to the Extended Latent Attention Networks (ELAN) module in the backbone network and the concatenation layer in the feature fusion module to enhance important weed features and suppress irrelevant features. In addition, the contextual transformer (CoT) module, a transformer-based architectural design, was used to capture global information and enhance self-attention by mining contextual information between neighboring keys. Finally, the Wise Intersection over Union (WIoU) loss function introducing a dynamic nonmonotonic focusing mechanism was employed to better predict the bounding boxes of the occluded weed. Results and discussion: The ablation experiment results showed that the CSCW-YOLOv7 achieved the best performance among the other models. The accuracy, recall, and mean average precision (mAP) values of the CSCW-YOLOv7 were 97.7%, 98%, and 94.4%, respectively. Compared with the baseline YOLOv7, the improved CSCW-YOLOv7 obtained precision, recall, and mAP increases of 1.8%, 1%, and 2.1%, respectively. Meanwhile, the parameters were compressed by 10.7% with a 3.8-MB reduction, resulting in a 10% decrease in floating-point operations per second (FLOPs). The Gradient-weighted Class Activation Mapping (Grad-CAM) visualization method suggested that the CSCW-YOLOv7 can learn a more representative set of features that can help better locate the weeds of different scales in complex field environments. In addition, the performance of the CSCW-YOLOv7 was compared to the widely used deep learning models, and results indicated that the CSCW-YOLOv7 exhibits a better ability to distinguish the overlapped weeds and small-scale weeds. The overall results suggest that the CSCW-YOLOv7 is a promising tool for the detection of weeds and has great potential for field applications.

WeedsNet: a dual attention network with RGB-D image for weed detection in natural wheat field

Multi-Modal Deep Learning for Weeds Detection in Wheat Field Based on RGB-D Images

WeedNet-R: a sugar beet field weed detection algorithm based on enhanced RetinaNet and context semantic fusion

Recognition of Weeds in Wheat Fields Based on the Fusion of RGB Images and Depth Images

DenseNet weed recognition model combining local variance preprocessing and attention mechanism

Two-Stream Dense Feature Fusion Network Based on RGB-D Data for the Real-Time Prediction of Weed Aboveground Fresh Weight in a Field Environment

Evaluation of Different Deep Convolutional Neural Networks for Detection of Broadleaf Weed Seedlings in Wheat.

A Lightweight Weed Detection Model with Global Contextual Joint Features

Lightweight cabbage segmentation network and improved weed detection method

Research on weed identification in soybean fields based on the lightweight segmentation model DCSAnet

Graph weeds net: A graph-based deep learning method for weed recognition

Research on Field Soybean Weed Identification Based on an Improved UNet Model Combined With a Channel Attention Mechanism

Weed detection and recognition in complex wheat fields based on an improved YOLOv7

Real-Time Crop Recognition In Transplanted Fields With Prominent Weed Growth: A Visual-Attention-Based Approach

A Segmentation Network for Smart Weed Management in Wheat Fields.

Segmentation of Weeds and Crops Using Multispectral Imaging and Crf-Enhanced U-Net

Real-time Segmentation of Weeds in Cornfields Based on Depthwise Separable Convolution Residual Network.

WeedMap: A Large-Scale Semantic Weed Mapping Framework Using Aerial Multispectral Imaging and Deep Neural Network for Precision Farming

Efficient Crop Segmentation Net and Novel Weed Detection Method

Improving U-net network for semantic segmentation of corns and weeds during corn seedling stage in field

A deep learning-based method for classification, detection, and localization of weeds in turfgrass.