Abstract:Weed control is a global issue of great concern, and smart weeding robots equipped with advanced vision algorithms can perform efficient and precise weed control. Furthermore, the application of smart weeding robots has great potential for building environmentally friendly agriculture and saving human and material resources. However, most networks used in intelligent weeding robots tend to solely prioritize enhancing segmentation accuracy, disregarding the hardware constraints of embedded devices. Moreover, generalized lightweight networks are unsuitable for crop and weed segmentation tasks. Therefore, we propose an Attention-aided lightweight network for crop and weed semantic segmentation. The proposed network has a parameter count of 0.11M, Floating-point Operations count of 0.24G. Our network is based on an encoder and decoder structure, incorporating attention module to ensures both fast inference speed and accurate segmentation while utilizing fewer hardware resources. The dual attention block is employed to explore the potential relationships within the dataset, providing powerful regularization and enhancing the generalization ability of the attention mechanism, it also facilitates information integration between channels. To enhance the local and global semantic information acquisition and interaction, we utilize the refinement dilated conv block instead of 2D convolution within the deep network. This substitution effectively reduces the number and complexity of network parameters and improves the computation rate. To preserve spatial information, we introduce the spatial connectivity attention block. This block not only acquires more precise spatial information but also utilizes shared weight convolution to handle multi-stage feature maps, thereby further reducing network complexity. The segmentation performance of the proposed network is evaluated on three publicly available datasets: the BoniRob dataset, the Rice Seeding dataset, and the WeedMap dataset. Additionally, we measure the inference time and Frame Per Second on the NVIDIA Jetson Xavier NX embedded system, the results are 18.14 msec and 55.1 FPS. Experimental results demonstrate that our network maintains better inference speed on resource-constrained embedded systems and has competitive segmentation performance.

A Lightweight Bilateral Semantic Segmentation Network for Robots

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

Drivable Agricultural Road Region Detection Based on Pixel-Level Segmentation with Contextual Representation Augmentation

Towards Broad Learning Networks on Unmanned Mobile Robot for Semantic Segmentation

Implementation of a Lightweight Semantic Segmentation Algorithm in Road Obstacle Detection

Adaptive Multi-ROI Agricultural Robot Navigation Line Extraction Based on Image Semantic Segmentation

Improved Lightweight Semantic Segmentation Algorithm Based on DeepLabv3+ Network

PD-SegNet: Semantic Segmentation of Small Agricultural Targets in Complex Environments

A new real-time image semantic segmentation framework based on a lightweight deep convolutional encoder-decoder architecture for robotic environment sensing

3D Point Cloud Semantic Segmentation Toward Large-Scale Unstructured Agricultural Scene Classification

RoboSeg: Real-Time Semantic Segmentation on Computationally Constrained Robots

An Improved DeepLabv3+ Lightweight Network for Remote-Sensing Image Semantic Segmentation

A Semi-Supervised Domain Adaptive Learning Approach to Unstructured Road Region Semantic Segmentation for Greenhouse Robots

Efficient Semantic Segmentation for Large-Scale Agricultural Nursery Managements via Point Cloud-Based Neural Network

An Integrated in Situ Image Acquisition and Annotation Scheme for Instance Segmentation Models in Open Scenes with a Human–Robot Interaction Approach

Attention-aided lightweight networks friendly to smart weeding robot hardware resources for crops and weeds semantic segmentation

Lightweight Deep Learning Models for High-Precision Rice Seedling Segmentation from UAV-Based Multispectral Images

Farmland Segmentation from Remote Sensing Images Using Deep Learning Methods

Semantic Scene Mapping with Spatio-temporal Deep Neural Network for Robotic Applications

Real-Time Segmentation of Unstructured Environments by Combining Domain Generalization and Attention Mechanisms

Towards agricultural autonomy: crop row detection under varying field conditions using deep learning