Abstract:Real-time analysis of UAV low-altitude remote sensing images at airborne terminals facilitates the timely monitoring of weeds in the farmland. Aiming at the real-time identification of rice weeds by UAV low-altitude remote sensing, two improved identification models, MobileNetV2-UNet and FFB-BiSeNetV2, were proposed based on the semantic segmentation models U-Net and BiSeNetV2, respectively. The MobileNetV2-UNet model focuses on reducing the amount of calculation of the original model parameters, and the FFB-BiSeNetV2 model focuses on improving the segmentation accuracy of the original model. In this study, we first tested and compared the segmentation accuracy and operating efficiency of the models before and after the improvement on the computer platform, and then transplanted the improved models to the embedded hardware platform Jetson AGX Xavier, and used TensorRT to optimize the model structure to improve the inference speed. Finally, the real-time segmentation effect of the two improved models on rice weeds was further verified through the collected low-altitude remote sensing video data. The results show that on the computer platform, the MobileNetV2-UNet model reduced the amount of network parameters, model size, and floating point calculations by 89.12%, 86.16%, and 92.6%, and the inference speed also increased by 2.77 times, when compared with the U-Net model. The FFB-BiSeNetV2 model improved the segmentation accuracy compared with the BiSeNetV2 model and achieved the highest pixel accuracy and mean Intersection over Union ratio of 93.09% and 80.28%. On the embedded hardware platform, the optimized MobileNetV2-UNet model and FFB-BiSeNetV2 model inferred 45.05 FPS and 40.16 FPS for a single image under the weight accuracy of FP16, respectively, both meeting the performance requirements of real-time identification. The two methods proposed in this study realize the real-time identification of rice weeds under low-altitude remote sensing by UAV, which provide a reference for the subsequent integrated operation of plant protection drones in real-time rice weed identification and precision spraying.

Trailer hopper automatic detection method for silage harvesting based improved U-Net

Labour-saving Detection of Hybrid Rice Rows at the Pollination Stage Based on a Multi-Perturbed Semi-Supervised Model

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

AGHRNet: an Attention Ghost-Hrnet for Confirmation of Catch‐and‐shake Locations in Jujube Fruits Vibration Harvesting

YOLOv5-AC: A Method of Uncrewed Rice Transplanter Working Quality Detection

Adaptive Multi-ROI Agricultural Robot Navigation Line Extraction Based on Image Semantic Segmentation

Hybrid Rice Row Detection at the Pollination Stage Based on Vanishing Point and Line-Scanning Method

Grain Truck Loading Status Detection Based on Machine Vision

Research of real-time corn yield monitoring system with DNN-based prediction model

Recognition of Field Roads Based on Improved U-Net++ Network

Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4

A Convolutional Neural Network-Based Method for Corn Stand Counting in the Field

Detection of Miss-Seeding of Sweet Corn in a Plug Tray Using a Residual Attention Network

Design of Fruit-Carrying Monitoring System for Monorail Transporter in Mountain Orchard

Improving U-net network for semantic segmentation of corns and weeds during corn seedling stage in field

RL-DeepLabv3+: A lightweight rice lodging semantic segmentation model for unmanned rice harvester

Tasseled Crop Rows Detection Based on Micro-Region of Interest and Logarithmic Transformation

Maize Tassel Area Dynamic Monitoring Based on Near-Ground and UAV RGB Images by U-Net Model

Real-Time Identification of Rice Weeds by UAV Low-Altitude Remote Sensing Based on Improved Semantic Segmentation Model

An Online Method for Detecting Seeding Performance Based on Improved YOLOv5s Model