Abstract:Background: Rice field weed object detection can provide key information on weed species and locations for precise spraying, which is of great significance in actual agricultural production. However, facing the complex and changing real farm environments, traditional object detection methods still have difficulties in identifying small-sized, occluded and densely distributed weed instances. To address these problems, this paper proposes a multi-scale feature enhanced DETR network, named RMS-DETR. By adding multi-scale feature extraction branches on top of DETR, this model fully utilizes the information from different semantic feature layers to improve recognition capability for rice field weeds in real-world scenarios. Methods: Introducing multi-scale feature layers on the basis of the DETR model, we conduct a differentiated design for different semantic feature layers. The high-level semantic feature layer adopts Transformer structure to extract contextual information between barnyard grass and rice plants. The low-level semantic feature layer uses CNN structure to extract local detail features of barnyard grass. Introducing multi-scale feature layers inevitably leads to increased model computation, thus lowering model inference speed. Therefore, we employ a new type of Pconv (Partial convolution) to replace traditional standard convolutions in the model. Results: Compared to the original DETR model, our proposed RMS-DETR model achieved an average recognition accuracy improvement of 3.6% and 4.4% on our constructed rice field weeds dataset and the DOTA public dataset, respectively. The average recognition accuracies reached 0.792 and 0.851, respectively. The RMS-DETR model size is 40.8 M with inference time of 0.0081 s. Compared with three classical DETR models (Deformable DETR, Anchor DETR and DAB-DETR), the RMS-DETR model respectively improved average precision by 2.1%, 4.9% and 2.4%. Discussion: This model is capable of accurately identifying rice field weeds in complex real-world scenarios, thus providing key technical support for precision spraying and management of variable-rate spraying systems.

Feature Deformation Network with Multi-Range Feature Enhancement for Agricultural Machinery Operation Mode Identification

TFSF: Topological and Feature Space Fusion with Spatio-Temporal Modeling for Crop Yield Prediction.

Field–Road Operation Classification of Agricultural Machine GNSS Trajectories Using Spatio-Temporal Neural Network

Field & Road-CENet: Semantic Segmentation for Agricultural Machinery Trajectory Segmentation

Addressing Local Sparsity in Massive Agricultural Machinery Trajectories: A BiLSTM-GRU Approach

Field-road Classification for Agricultural Vehicles in China Based on Pre-Trained Visual Model

Reconstruction of Missing Points in Agricultural Machinery Trajectory Based on Bidirectional Adjacent Information

Field-road Classification for GNSS Recordings of Agricultural Machinery Using Pixel-Level Visual Features.

Identifying Field and Road Modes of Agricultural Machinery Based on GNSS Recordings: A Graph Convolutional Neural Network Approach

A Neural Network Fusing Local and Global Trajectory Features for Field-Road Mode Classification

A Bagging-SVM Field-Road Trajectory Classification Model Based on Feature Enhancement

Semantic information extraction and automatic interpretation of winter wheat based on a deformable full convolutional neural network

Identifying Working Trajectories of the Wheat Harvester In-Field Based on K-Means Algorithm

Multi-view density-based field-road classification for agricultural machinery: DBSCAN and object detection

Trajectory classification to support effective and efficient field-road classification

Research of real-time corn yield monitoring system with DNN-based prediction model

Identifying rice field weeds from unmanned aerial vehicle remote sensing imagery using deep learning

Global Context-Aware-Based Deformable Residual Network Module for Precise Pest Recognition and Detection

Recognition of Field Roads Based on Improved U-Net++ Network

Attention-Based Multiscale Feature Pyramid Network for Corn Pest Detection under Wild Environment

Multi-Crop Navigation Line Extraction Based on Improved YOLO-v8 and Threshold-DBSCAN under Complex Agricultural Environments