Abstract:Weed control is a global issue of great concern, and smart weeding robots equipped with advanced vision algorithms can perform efficient and precise weed control. Furthermore, the application of smart weeding robots has great potential for building environmentally friendly agriculture and saving human and material resources. However, most networks used in intelligent weeding robots tend to solely prioritize enhancing segmentation accuracy, disregarding the hardware constraints of embedded devices. Moreover, generalized lightweight networks are unsuitable for crop and weed segmentation tasks. Therefore, we propose an Attention-aided lightweight network for crop and weed semantic segmentation. The proposed network has a parameter count of 0.11M, Floating-point Operations count of 0.24G. Our network is based on an encoder and decoder structure, incorporating attention module to ensures both fast inference speed and accurate segmentation while utilizing fewer hardware resources. The dual attention block is employed to explore the potential relationships within the dataset, providing powerful regularization and enhancing the generalization ability of the attention mechanism, it also facilitates information integration between channels. To enhance the local and global semantic information acquisition and interaction, we utilize the refinement dilated conv block instead of 2D convolution within the deep network. This substitution effectively reduces the number and complexity of network parameters and improves the computation rate. To preserve spatial information, we introduce the spatial connectivity attention block. This block not only acquires more precise spatial information but also utilizes shared weight convolution to handle multi-stage feature maps, thereby further reducing network complexity. The segmentation performance of the proposed network is evaluated on three publicly available datasets: the BoniRob dataset, the Rice Seeding dataset, and the WeedMap dataset. Additionally, we measure the inference time and Frame Per Second on the NVIDIA Jetson Xavier NX embedded system, the results are 18.14 msec and 55.1 FPS. Experimental results demonstrate that our network maintains better inference speed on resource-constrained embedded systems and has competitive segmentation performance.

Real‐time semantic segmentation network for crops and weeds based on multi‐branch structure

A Novel Adaptive Zone-fusion Network for Precise Waxberry Semantic Segmentation to Improve Automated-Harvesting in a Complex Orchard Environment

Multi-level feature re-weighted fusion for the semantic segmentation of crops and weeds

Real-time Segmentation of Weeds in Cornfields Based on Depthwise Separable Convolution Residual Network.

Efficient Crop Segmentation Net and Novel Weed Detection Method

SWFormer: A Scale-Wise Hybrid CNN-Transformer Network for Multi-Classes Weed Segmentation

Semantic Segmentation for Weed Detection in Corn.

An Improved U-Net Model Based on Multi-Scale Input and Attention Mechanism: Application for Recognition of Chinese Cabbage and Weed

A Modified U-Net with a Specific Data Argumentation Method for Semantic Segmentation of Weed Images in the Field.

Semantic Segmentation of Crop and Weed using an Encoder-Decoder Network and Image Enhancement Method under Uncontrolled Outdoor Illumination

An accurate semantic segmentation model for bean seedlings and weeds identification based on improved ERFnet

An Instance Segmentation-Based Method to Obtain the Leaf Age and Plant Centre of Weeds in Complex Field Environments

Improving U-net network for semantic segmentation of corns and weeds during corn seedling stage in field

An Improved Transformer Network With Multi-Scale Convolution for Weed Identification in Sugarcane Field

Attention-aided lightweight networks friendly to smart weeding robot hardware resources for crops and weeds semantic segmentation

FG-UNet: fine-grained feature-guided UNet for segmentation of weeds and crops in UAV images

WeedMap: A Large-Scale Semantic Weed Mapping Framework Using Aerial Multispectral Imaging and Deep Neural Network for Precision Farming

Multi-species Weed Density Assessment Based on Semantic Segmentation Neural Network

Research on Field Soybean Weed Identification Based on an Improved UNet Model Combined With a Channel Attention Mechanism

Research on weed identification in soybean fields based on the lightweight segmentation model DCSAnet

Lightweight cabbage segmentation network and improved weed detection method