PAM-FOG Net: A Lightweight Weed Detection Model Deployed on Smart Weeding Robots

Jiahua Bao,Siyao Cheng,Jie Liu
DOI: https://doi.org/10.1145/3641821
2024-01-22
ACM Transactions on Sensor Networks
Abstract:Visual target detection based on deep learning with high computing power devices has been successful, but the performance in intelligent agriculture with edge devices has not been prominent. Specifically, the existing model architecture and optimization methods are not well-suited to low-power edge devices, the agricultural tasks such as weed detection require high accuracy, short inference latency, and low cost. Although there are automated tuning methods available, the search space is extremely large, using existing models for compression and optimization greatly wastes tuning resources. In this article, we propose a lightweight PAM-FOG net based on weed distribution and projection mapping. More significantly, we propose a novel model compression optimization method to fit our model. Compared with other models, PAM-FOG net runs on smart weeding robots supported by edge devices, and achieves superior accuracy and high frame rate. We effectively balance model size, performance and inference speed, reducing the original model size by nearly 50%, power consumption by 26%, and improving the frame rate by 40%. It shows the effectiveness of our model architecture and optimization method, which provides a reference for the future development of deep learning in intelligent agriculture.
computer science, information systems,telecommunications
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper aims to address the performance issues of weed detection models on edge devices in smart agriculture. Specifically: 1. **Existing model architectures and optimization methods are not suitable for low-power edge devices**: While current deep learning models perform well on high-performance computing devices, they perform poorly on low-power edge devices (such as smart weeding robots). 2. **Agricultural tasks require high accuracy, short inference delay, and low cost**: Agricultural tasks like weed detection require high accuracy, fast response, and low operational cost. 3. **Existing model compression and optimization methods waste tuning resources**: Despite the availability of automatic tuning methods, using existing models for compression and optimization wastes a lot of tuning resources due to the vast search space. To address these issues, the paper proposes a lightweight PAM-FOG network, combined with weed distribution and projection mapping techniques, and introduces new model compression and optimization methods. This model can run on smart weeding robots, achieving high accuracy and high frame rates while effectively balancing model size, performance, and inference speed.