Crop insect pest detection based on dilated multi-scale attention U-Net

Xuqi Wang,Shanwen Zhang,Ting Zhang

DOI: https://doi.org/10.1186/s13007-024-01163-w

IF: 5.827

2024-02-29

Plant Methods

Abstract:Crop pests seriously affect the yield and quality of crops. Accurately and rapidly detecting and segmenting insect pests in crop leaves is a premise for effectively controlling insect pests.

plant sciences,biochemical research methods

What problem does this paper attempt to address?

Localization and recognition of pests in tea plantation based on image saliency analysis and convolutional neural network

Yang Guoguo,Bao Yidan,Liu Ziyi

DOI: https://doi.org/10.11975/j.issn.1002-6819.2017.06.020

2017-01-01

Abstract:Tea is one of important cash crops in China. Computer vision plays an important role in pest detection. Automatic classification of insect species in field is more difficult than the generic object classification because of complex background in filed and high appearance similarity among insect species. In this paper, we proposed an insect recognition system on the basis of image saliency analysis and a deep learning model, i.e. convolutional neural network (CNN), which has a good robustness with avoiding the features selected by artificial means. In image saliency analysis, we segmented the original images into super-pixel regions firstly. Then we quantized each RGB (red, green, blue) color channel and made them have 10 different values, which reduced the number of colors to 1000, and sped up the process of the color contrast of the pest objects and the background at region level. Finally, we obtained the saliency value of each region by combining their color contrast and spatial distances. The saliency values of all regions in each image were used to construct a saliency map, which was offered as the initial area for GrabCut algorithm to define the segmentation result and localize the pest object. The images after localization were quantized to 256×256 dpi for CNN training and classifying. CNN was trained end to end, from raw pixels to ultimate categories, thereby alleviating the requirement to manually design a suitable feature extractor. Based on theoretical analysis and experimental evaluation, we optimized the critical structure parameters and training strategy of CNN to seek the best configuration. The overall architecture included a number of sensitive parameters and optimization strategies that could be changed. We determined the local receptive field size, number, and convolutional stride as 7×7 dpi, 64 and 4, respectively. Dropout ratio for the fully-connected layers was 0.7. The loss function Softmax was fit for the pest classification system. To further improve the practical utility of CNN, we focused on structural changes of the overall architecture that enabled a faster running with small effects on the performance. We analyzed the performance and the corresponding runtime of our model by reducing its depth (number of layers) and width (number of convolution kernel in each layer). Removing the fully-connected layers (FC6, FC7) made only a slight difference to the overall architecture. These layers contained almost 90% of the parameters and when they were removed, the memory consumption decreased to 29.8 MB. But, removing the intermediate convolutional layers (Conv2, Conv3, Conv4, Conv5) resulted in a dramatic decrease in both accuracy and runtime. This suggested that the intermediate convolutional layers (Conv2, Conv3, Conv4, Conv5) constituted the main part of the computational resource, and their depth was important for achieving good results. We then investigated the effects of adjusting the sizes of all convolutional layers, and the filters in each convolutional layer were reduced to 64 each time. Surprisingly, all architectures showed significant decreases in running time with relatively small effects on performance. Finally, we determined the convolution kernel numbers of Conv2-Conv5: 64-192-192-64. On the test set of tea field images, the architecture before and after shrinking respectively achieved the average accuracy (AA) of 0.915 and 0.881, respectively, superior to previous methods for pest image recognition. Further, after optimization the running time reduced to 0.7 ms and the memory required was 6 MB.
Crop pest detection by three-scale convolutional neural network with attention

Xuqi Wang,Shanwen Zhang,Xianfeng Wang,Cong Xu

DOI: https://doi.org/10.1371/journal.pone.0276456

IF: 3.7

2023-06-02

PLoS ONE

Abstract:Crop pests seriously affect the yield and quality of crop. To timely and accurately control crop pests is particularly crucial for crop security, quality of life and a stable agricultural economy. Crop pest detection in field is an essential step to control the pests. The existing convolutional neural network (CNN) based pest detection methods are not satisfactory for small pest recognition and detection in field because the pests are various with different colors, shapes and poses. A three-scale CNN with attention (TSCNNA) model is constructed for crop pest detection by adding the channel attention and spatial mechanisms are introduced into CNN. TSCNNA can improve the interest of CNN for pest detection with different sizes under complicated background, and enlarge the receptive field of CNN, so as to improve the accuracy of pest detection. Experiments are carried out on the image set of common crop pests, and the precision is 93.16%, which is 5.1% and 3.7% higher than ICNN and VGG16, respectively. The results show that the proposed method can achieve both high speed and high accuracy of crop pest detection. This proposed method has certain practical significance of real-time crop pest control in the field.

multidisciplinary sciences
Attention-Based Multiscale Feature Pyramid Network for Corn Pest Detection under Wild Environment

Chenrui Kang,Lin Jiao,Rujing Wang,Zhigui Liu,Jianming Du,Haiying Hu,Kang,Jiao,Wang,Liu,Du,Hu

DOI: https://doi.org/10.3390/insects13110978

2022-10-26

Insects

Abstract:A serious outbreak of agricultural pests results in a great loss of corn production. Therefore, accurate and robust corn pest detection is important during the early warning, which can achieve the prevention of the damage caused by corn pests. To obtain an accurate detection of corn pests, a new method based on a convolutional neural network is introduced in this paper. Firstly, a large-scale corn pest dataset has been constructed which includes 7741 corn pest images with 10 classes. Secondly, a deep residual network with deformable convolution has been introduced to obtain the features of the corn pest images. To address the detection task of multi-scale corn pests, an attention-based multi-scale feature pyramid network has been developed. Finally, we combined the proposed modules with a two-stage detector into a single network, which achieves the identification and localization of corn pests in an image. Experimental results on the corn pest dataset demonstrate that the proposed method has good performance compared with other methods. Specifically, the proposed method achieves 70.1% mean Average Precision (mAP) and 74.3% Recall at the speed of 17.0 frames per second (FPS), which balances the accuracy and efficiency.

entomology
Crop Pest Recognition in Real Agricultural Environment Using Convolutional Neural Networks by a Parallel Attention Mechanism

Shengyi Zhao,Jizhan Liu,Zongchun Bai,Chunhua Hu,Yujie Jin

DOI: https://doi.org/10.3389/fpls.2022.839572

IF: 5.6

2022-02-21

Frontiers in Plant Science

Abstract:Crop pests are a major agricultural problem worldwide because the severity and extent of their occurrence threaten crop yield. However, traditional pest image segmentation methods are limited, ineffective and time-consuming, which causes difficulty in their promotion and application. Deep learning methods have become the main methods to address the technical challenges related to pest recognition. We propose an improved deep convolution neural network to better recognize crop pests in a real agricultural environment. The proposed network includes parallel attention mechanism module and residual blocks, and it has significant advantages in terms of accuracy and real-time performance compared with other models. Extensive comparative experiment results show that the proposed model achieves up to 98.17% accuracy for crop pest images. Moreover, the proposed method also achieves a better performance on the other public dataset. This study has the potential to be applied in real-world applications and further motivate research on pest recognition.

plant sciences
Image segmentation for pest detection of crop leaves by improvement of regional convolutional neural network

Xianchuan Wu,Yuling Liu,Mingjing Xing,Chun Yang,Shaoyong Hong

DOI: https://doi.org/10.1038/s41598-024-75391-4

IF: 4.6

2024-10-17

Scientific Reports

Abstract:Pest detection is important for crop cultivation. Crop leaf is the main place of pest invasion. Current technologies to detect crop pests have constraints, such as low efficiency, storage demands and limited precision. Image segmentation is a fast and efficient computer-aided detection technology. High resolution image capture solidly supports the crucial processes in discerning pests from images. Study of analytical methods help parse information in the images. In this paper, a regional convolutional neural network (R-CNN) architecture is designed in combination with the radial bisymmetric divergence (RBD) method for enhancing the efficiency of image segmentation. As a special application of RBD, the hierarchical mask (HM) is produced to endorse detection and classification of the leaf-dwelling pests, offering enhanced efficiency and reduced storage requirements. Moreover, to deal with some mislabeled data, a threshold variable is introduced to adjust a fault-tolerant mechanism into HM, to generate a novel threshold-based hierarchical mask (TbHM). Consequently, the hierarchical mask R-CNN (HM-R-CNN) model and the threshold-based hierarchical mask R-CNN (TbHM-R-CNN) model are established to detect various types of healthy and pest-invasive crop leaves to select the regional image features that are rich in pest information. Then simple linear iterative clustering (SLIC) method is incorporation to finish the image segmentation for the classification of pest invasion. The models are tuned and optimized, then validated. The most optimized modeling results are from the TbHM-R-CNN model, with the classification accuracy of 96.2%, the recall of 97.5% and the F1 score of 0.982. Additionally, the HM-R-CNN model observed appreciable results second only to the best model. These results indicate that the proposed methodologies are well-suited for training and testing a dataset of plant diseases, offering heightened accuracy in pest classification. This study revealed that the proposed methods significantly outperform the existing techniques, marking a substantial improvement over current methods.

multidisciplinary sciences
Cascaded Aggregation Convolution Network for Salient Grain Pests Detection

Junwei Yu,Shihao Chen,Nan Liu,Fupin Zhai,Quan Pan

DOI: https://doi.org/10.3390/insects15070557

2024-07-22

Insects

Abstract:Pest infestation poses significant threats to grain storage due to pests' behaviors of feeding, respiration, excretion, and reproduction. Efficient pest detection and control are essential to mitigate these risks. However, accurate detection of small grain pests remains challenging due to their small size, high variability, low contrast, and cluttered background. Salient pest detection focuses on the visual features that stand out, improving the accuracy of pest identification in complex environments. Drawing inspiration from the rapid pest recognition abilities of humans and birds, we propose a novel Cascaded Aggregation Convolution Network (CACNet) for pest detection and control in stored grain. Our approach aims to improve detection accuracy by employing a reverse cascade feature aggregation network that imitates the visual attention mechanism in humans when observing and focusing on objects of interest. The CACNet uses VGG16 as the backbone network and incorporates two key operations, namely feature enhancement and feature aggregation. These operations merge the high-level semantic information and low-level positional information of salient objects, enabling accurate segmentation of small-scale grain pests. We have curated the GrainPest dataset, comprising 500 images showcasing zero to five or more pests in grains. Leveraging this dataset and the MSRA-B dataset, we validated our method's efficacy, achieving a structure S-measure of 91.9%, and 90.9%, and a weighted F-measure of 76.4%, and 91.0%, respectively. Our approach significantly surpasses the traditional saliency detection methods and other state-of-the-art salient object detection models based on deep learning. This technology shows great potential for pest detection and assessing the severity of pest infestation based on pest density in grain storage facilities. It also holds promise for the prevention and control of pests in agriculture and forestry.
Based on the multi-scale information sharing network of fine-grained attention for agricultural pest detection

Wang Linfeng,Liu Yong,Liu Jiayao,Wang Yunsheng,Xu Shipu

DOI: https://doi.org/10.1371/journal.pone.0286732

IF: 3.7

2023-10-05

PLoS ONE

Abstract:It is of great significance to identify the pest species accurately and control it effectively to reduce the loss of agricultural products. The research results of this project will provide theoretical basis for preventing and controlling the spread of pests and reducing the loss of agricultural products, and have important practical significance for improving the quality of agricultural products and increasing the output of agricultural products. At the same time, it provides a kind of effective prevention and control measures for farmers, so as to ensure the safety and health of crops. Because of the slow speed and high cost of manual identification, it is necessary to establish a set of automatic pest identification system. The traditional image-based insect classifier is mainly realized by machine vision technology, but because of its high complexity, the classification efficiency is low and it is difficult to meet the needs of applications. Therefore, it is necessary to develop a new automatic insect recognition system to improve the accuracy of insect classification. There are many species and forms of insects, and the field living environment is complex. The morphological similarity between species is high, which brings difficulties to the classification of insects. In recent years, with the rapid development of deep learning technology, using artificial neural network to classify pests is an important method to establish a fast and accurate classification model. In this work, we propose a novel convolutional neural network-based model (MSSN), which includes attention mechanism, feature pyramid, and fine-grained model. The model has good scalability, can better capture the semantic information in the image, and achieve more accurate classification. We evaluated our approach on a common data set: large-scale pest data set, PlantVillage benchmark data set, and evaluated model performance using a variety of evaluation indicators, namely, macro mean accuracy (MPre), macro mean recall rate (MRec), macro mean F1-score (MF1), Accuracy (Acc) and geometric mean (GM). Experimental results show that the proposed algorithm has better performance and universality ability than the existing algorithm. For example, on the data set, the maximum accuracy we obtained was 86.35%, which exceeded the corresponding technical level. The ablation experiment was conducted on the experiment itself, and the comprehensive evaluation of the complete MSSN(scale 1+2+3) was the best in various performance indexes, demonstrating the feasibility of the innovative method in this paper.
MULTI-TARGET DETECTION METHOD FOR MAIZE PESTS BASED ON IMPROVED YOLOv8

Qiuyan LIANG,Zihan ZHAO,Jingye SUN,Tianyue JIANG,Ningning GUO,Haiyang YU,Yiyuan GE

DOI: https://doi.org/10.35633/inmateh-73-19

2024-08-01

INMATEH Agricultural Engineering

Abstract:When maize is afflicted by pests and diseases, it can lead to a drastic reduction in yield, causing significant economic losses to farmers. Therefore, accurate and efficient detection of maize pest species is crucial for targeted pest control during the management process. To achieve precise detection of maize pest species, this paper proposes a deep learning detection algorithm for maize pests based on an improved YOLOv8n model: Firstly, a maize pest dataset was constructed, comprising 2,756 images of maize pests, according to the types of pests and diseases. Secondly, a deformable attention mechanism (DAttention) was introduced into the backbone network to enhance the model's capability to extract features from images of maize pests. Thirdly, spatial and channel recombination convolution (SCConv) was incorporated into the feature fusion network to reduce the miss rate of small-scale pests. Lastly, the improved model was trained and tested using the newly constructed maize pest dataset. Experimental results demonstrate that the improved model achieved a detection average precision (mAP) of 94.8% at a speed of 171 frames per second (FPS), balancing accuracy and efficiency. The enhanced model can be deployed on low-power mobile devices for real-time detection, which is of great significance for the healthy development of maize agriculture.
MSR-RCNN: A Multi-Class Crop Pest Detection Network Based on a Multi-Scale Super-Resolution Feature Enhancement Module

Yue Teng,Jie Zhang,Shifeng Dong,Shijian Zheng,Liu Liu

DOI: https://doi.org/10.3389/fpls.2022.810546

IF: 5.6

2022-03-03

Frontiers in Plant Science

Abstract:Pest disaster severely reduces crop yield and recognizing them remains a challenging research topic. Existing methods have not fully considered the pest disaster characteristics including object distribution and position requirement, leading to unsatisfactory performance. To address this issue, we propose a robust pest detection network by two customized core designs: multi-scale super-resolution (MSR) feature enhancement module and Soft-IoU (SI) mechanism. The MSR (a plug-and-play module) is employed to improve the detection performance of small-size, multi-scale, and high-similarity pests. It enhances the feature expression ability by using a super-resolution component, a feature fusion mechanism, and a feature weighting mechanism. The SI aims to emphasize the position-based detection requirement by distinguishing the performance of different predictions with the same Intersection over Union (IoU). In addition, to prosper the development of agricultural pest detection, we contribute a large-scale light-trap pest dataset (named LLPD-26), which contains 26-class pests and 18,585 images with high-quality pest detection and classification annotations. Extensive experimental results over multi-class pests demonstrate that our proposed method achieves the best performance by 67.4% of mAP on the LLPD-26 while being 15.0 and 2.7% gain than state-of-the-art pest detection AF-RCNN and HGLA respectively. Ablation studies verify the effectiveness of the proposed components.

plant sciences
Detection of Rice Pests Based on Self-Attention Mechanism and Multi-Scale Feature Fusion

Yuqi Hu,Xiaoling Deng,Yubin Lan,Xin Chen,Yongbing Long,Cunjia Liu

DOI: https://doi.org/10.3390/insects14030280

2023-03-14

Insects

Abstract:In recent years, the occurrence of rice pests has been increasing, which has greatly affected the yield of rice in many parts of the world. The prevention and cure of rice pests is urgent. Aiming at the problems of the small appearance difference and large size change of various pests, a deep neural network named YOLO-GBS is proposed in this paper for detecting and classifying pests from digital images. Based on YOLOv5s, one more detection head is added to expand the detection scale range, the global context (GC) attention mechanism is integrated to find targets in complex backgrounds, PANet is replaced by BiFPN network to improve the feature fusion effect, and Swin Transformer is introduced to take full advantage of the self-attention mechanism of global contextual information. Results from experiments on our insect dataset containing Crambidae, Noctuidae, Ephydridae, and Delphacidae showed that the average mAP of the proposed model is up to 79.8%, which is 5.4% higher than that of YOLOv5s, and the detection effect of various complex scenes is significantly improved. In addition, the paper analyzes and discusses the generalization ability of YOLO-GBS model on a larger-scale pest data set. This research provides a more accurate and efficient intelligent detection method for rice pests and others crop pests.

entomology
Pest-ConFormer: A Hybrid CNN-Transformer Architecture for Large-Scale Multi-Class Crop Pest Recognition

Mingwei Fang,Zhiping Tan,Yu Tang,Weizhao Chen,Huasheng Huang,Sathian Dananjayan,Yong He,Shaoming Luo

DOI: https://doi.org/10.1016/j.eswa.2024.124833

IF: 8.5

2024-01-01

Expert Systems with Applications

Abstract:Crop pests are acknowledged as the major factors in reducing the yield and quality of agricultural production worldwide. It is an urgent necessity to recognize crop pests accurately to protect the crop in the early stage to reduce the loss for the agricultural economy. Due to the ecological characteristics of the crop pests and the complex background in fields, the crop pests show high inter-class similarity and significant intra-class variation in external morphology appearance, which makes current recognition methods suffer from low classification accuracy and poor generalization ability in complex natural environment recognition tasks. To tackle this problem, a hybrid convolutional neural network and transformer-based model, namely Pest-ConFormer, featured with multi-scale weakly supervised feature selection mechanisms is proposed, which has shown excellent multiscale discriminative feature extraction in fine-grained visual classification (FGVC) tasks. This method employs a hybrid convolution-transformer encoder architecture pre-training in a self-supervised masked autoencoder manner as a backbone to learn pests' highly discriminative features across various scales. Next, a dual-path feature aggregation structure with a top-down FPN-like feature pathway and a bottom-up PANet-like feature pathway based on attention mechanisms is designed to learn high-level global context information and low-level local detailed feature representation. Thirdly, a fine-grained classification module using weakly supervised learning is introduced to select the discriminative feature points in different pyramidal levels. Then, these feature points are fed into a graph convolutional network to accomplish classification. Several experiments are conducted on the large-scale multi-class IP102 benchmark dataset, and the proposed method achieves an accuracy of 77.81 % regarding crop pest recognition. The experimental results indicate that our approach outperforms other state-of-the-art methods by nearly 2 percent points, demonstrating that the proposed hybrid architecture with dual-path feature aggregation and fine-grained classification modules can be more effective in the crop pest recognition field than CNN-based methods and can be deployed in the practical natural environment. The source code will be available at https://github.com/mwfang/pestconformer.
Rethinking the Crop Row Detection Pipeline: an End-to-end Method for Crop Row Detection Based on Row-Column Attention

Boliao Li,Dongfang Li,Zhenbo Wei,Jun Wang

DOI: https://doi.org/10.1016/j.compag.2024.109264

IF: 8.3

2024-01-01

Computers and Electronics in Agriculture

Abstract:Vision-based autonomous navigation technology is vital important for unmanned driving of agricultural machinery and precise operation. Crop row detection, a fundamental task of vision-based navigation, has a significant impact on automatic navigation. The current pipeline for crop row detection is cumbersome and requires multiple steps with manually adjusted parameters, which limits the accuracy, speed, and robustness of crop row detection. This study proposed an end-to-end deep neural network based on row-column attention to simplify the pipeline of crop row detection. The network can directly output the coordinate representation of crop rows in the image without additional complex post-processing and manual parameter adjustment steps. In the model design, crop row was defined as a collection of points distributed in the image. The row-column attention mechanism, used in the transformer-based encoder-decoder network, was proposed to scratch the row and column features, which could help generate more detailed crop rows. The LineIoU loss and Line Location loss were designed to make the network focus on the position and shape information of the crop rows, which can enhance response speed, precision, stability of the proposed network. Experiments on tea and vegetable dataset showed that the model achieved 95.75 % accuracy and the average lateral distance between prediction and ground truth was 8.8 pixel. Compared with the existing SOTA model, the accuracy of the model is improved 8.5 % and the average running time of processing a 1920 x 1080 size image is 23.81 ms.
FESNet: Frequency-Enhanced Saliency Detection Network for Grain Pest Segmentation

Junwei Yu,Fupin Zhai,Nan Liu,Yi Shen,Quan Pan

DOI: https://doi.org/10.3390/insects14020099

2023-01-17

Insects

Abstract:As insect infestation is the leading factor accounting for nutritive and economic losses in stored grains, it is important to detect the presence and number of insects for the sake of taking proper control measures. Inspired by the human visual attention mechanism, we propose a U-net-like frequency-enhanced saliency (FESNet) detection model, resulting in the pixelwise segmentation of grain pests. The frequency clues, as well as the spatial information, are leveraged to enhance the detection performance of small insects from the cluttered grain background. Firstly, we collect a dedicated dataset, GrainPest, with pixel-level annotation after analyzing the image attributes of the existing salient object detection datasets. Secondly, we design a FESNet with the discrete wavelet transformation (DWT) and the discrete cosine transformation (DCT), both involved in the traditional convolution layers. As current salient object detection models will reduce the spatial information with pooling operations in the sequence of encoding stages, a special branch of the discrete wavelet transformation (DWT) is connected to the higher stages to capture accurate spatial information for saliency detection. Then, we introduce the discrete cosine transform (DCT) into the backbone bottlenecks to enhance the channel attention with low-frequency information. Moreover, we also propose a new receptive field block (NRFB) to enlarge the receptive fields by aggregating three atrous convolution features. Finally, in the phase of decoding, we use the high-frequency information and aggregated features together to restore the saliency map. Extensive experiments and ablation studies on our dataset, GrainPest, and open dataset, Salient Objects in Clutter (SOC), demonstrate that the proposed model performs favorably against the state-of-the-art model.
A Spatial Feature-Enhanced Attention Neural Network with High-Order Pooling Representation for Application in Pest and Disease Recognition

Jianlei Kong,Hongxing Wang,Chengcai Yang,Xuebo Jin,Min Zuo,Xin Zhang

DOI: https://doi.org/10.3390/agriculture12040500

2022-03-31

Agriculture

Abstract:With the development of advanced information and intelligence technologies, precision agriculture has become an effective solution to monitor and prevent crop pests and diseases. However, pest and disease recognition in precision agriculture applications is essentially the fine-grained image classification task, which aims to learn effective discriminative features that can identify the subtle differences among similar visual samples. It is still challenging to solve for existing standard models troubled by oversized parameters and low accuracy performance. Therefore, in this paper, we propose a feature-enhanced attention neural network (Fe-Net) to handle the fine-grained image recognition of crop pests and diseases in innovative agronomy practices. This model is established based on an improved CSP-stage backbone network, which offers massive channel-shuffled features in various dimensions and sizes. Then, a spatial feature-enhanced attention module is added to exploit the spatial interrelationship between different semantic regions. Finally, the proposed Fe-Net employs a higher-order pooling module to mine more highly representative features by computing the square root of the covariance matrix of elements. The whole architecture is efficiently trained in an end-to-end way without additional manipulation. With comparative experiments on the CropDP-181 Dataset, the proposed Fe-Net achieves Top-1 Accuracy up to 85.29% with an average recognition time of only 71 ms, outperforming other existing methods. More experimental evidence demonstrates that our approach obtains a balance between the model’s performance and parameters, which is suitable for its practical deployment in precision agriculture art applications.
An Efficient Approach for Crops Pests Recognition and Classification Based on Novel DeepPestNet Deep Learning Model

Naeem Ullah,Javed Ali Khan,Lubna Abdulaziz Alharbi,Asaf Raza,Wahab Khan,Ijaz Ahmad

DOI: https://doi.org/10.1109/access.2022.3189676

IF: 3.9

2022-07-23

IEEE Access

Abstract:Crop pests are to blame for significant economic, social, and environmental losses worldwide. Various pests have different control strategies, and precisely identifying pests has become crucial to pest control and is a significant difficulty in agriculture. Many agricultural professionals are interested in deep learning (DL) models since they have shown significant promise in image recognition. Pest identification approaches in literature have relatively low accuracy in pest recognition and classification due to the complexity of their algorithms and limited data availability. Misclassification of insect pests sometimes leads to using the wrong pesticides, causing harm to agricultural yields and the surrounding environment. It necessitates developing an automated system capable of more accurate pest identification and classification. This paper presents a novel end-to-end DeepPestNet framework for pest recognition and classification. The proposed model has 11 learnable layers, including eight convolutional and three fully connected (FC) layers. We used image rotations techniques to increase the size of the dataset and image augmentations techniques to test the generalizability of the proposed DeepPestNet approach. We used the popular Deng's crops data set to assess the proposed DeepPestNet framework. We used the proposed method to recognize and classify crop pests into 10-class pests, i.e., Locusta migratoria, Euproctis pseudoconspersa strand, chrysochus Chinensis, empoasca flavescens, Spodoptera exigua, larva of laspeyresia pomonella, parasa lepida, acrida cinerea, larva of S. exigua, and L.pomonella types of insects pests. The proposed method achieved optimal accuracy of 100%. We compared the proposed DeepPestNet approach with traditional pre-trained deep learning (DL) models. To verify the general adaptability of this model, we tested the proposed model on the standard Kaggle dataset "Pest Dataset" to reco- nize nine types of pests: aphids, armyworm, beetle, bollworm, grasshopper, mites, mosquito, sawfly, and stem borer and achieved an accuracy of 98.92%. The proposed model can provide specialists and farmers with immediate and effective aid in recognizing pests, potentially reducing economic and crop yield losses.

computer science, information systems,telecommunications,engineering, electrical & electronic
MS-ALN: Multiscale Attention Learning Network for Pest Recognition

Fuxiang Feng,Hanlin Dong,Youmei Zhang,Yu Zhang,Bin Li

DOI: https://doi.org/10.1109/access.2022.3167397

IF: 3.9

2022-01-01

IEEE Access

Abstract:Complex backgrounds, occlusions, and non-uniform classes present great challenges to pest recognition in practical applications. In this paper, we propose a multiscale attention learning network to address these problems. This network recursively locates discriminative regions and learns region-based feature representation in four branches. Three newly designed modules, which are target localization, attention detection, and attention removal connect two feature extracting sub-networks in adjacent branches to generate images of different scales. The target localization and attention detection modules locate the discriminative regions to filter out complex backgrounds while the attention removal module randomly removes the discriminative region to encourage the model to tackle occlusions. Thereafter, the parameter-shared classification sub-network follows the feature extracting sub-network in every branch for pest recognition. A decoupled learning strategy is adopted to address the problem of non-uniform classes. We experimented on the widely used IP-102 dataset and achieved state-of-the-art performance.

computer science, information systems,telecommunications,engineering, electrical & electronic
ESA-Net: An efficient scale-aware network for small crop pest detection

Shifeng Dong,Yue Teng,Lin Jiao,Jianming Du,Kang Liu,Rujing Wang

DOI: https://doi.org/10.1016/j.eswa.2023.121308

IF: 8.5

2023-09-10

Expert Systems with Applications

Abstract:Pest detection aims to locate and classify the pests that may be present in the image, which plays a crucial role in the early warning of pests linked to the agriculture industry. However, crop pests are generally very small and uneven in scale, resulting in poor detection results. To address this challenge, we propose the Efficient Scale-Aware Network (ESA-Net), which comprises three core components: a High-Level Semantic Feature Extraction Module (HSFEM), a Low-Level Feature Enhancement Module (LFEM), and a Dynamic Scale-Aware Head (DSH). To avoid network optimization confusion, we use the HSFEM to extract high-level features that build the feature pyramid networks. Then, the LFEM is designed to further optimize the integrated feature map of low-level features, providing more fine-gained information for feature extraction and improving the detector's ability to differentiate between pests with similar appearances. Additionally, the proposed DSH can improve the detection performance of small objects by adaptively selecting the appropriate detection receptive field in accordance with various object scales. Experiment results on LMPD2020 dataset (68.8% mAP) and APHIDc dataset (75.3% mAP) demonstrate that ESA-Net achieves competitive results compared to the state-of-the-art methods.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Crop pest image classification based on improved densely connected convolutional network

Hongxing Peng,Huiming Xu,Zongmei Gao,Zhiyan Zhou,Xingguo Tian,Qianting Deng,Huijun He,Chunlong Xian

DOI: https://doi.org/10.3389/fpls.2023.1133060

2023-04-03

Abstract:Introduction: Crop pests have a great impact on the quality and yield of crops. The use of deep learning for the identification of crop pests is important for crop precise management. Methods: To address the lack of data set and poor classification accuracy in current pest research, a large-scale pest data set named HQIP102 is built and the pest identification model named MADN is proposed. There are some problems with the IP102 large crop pest dataset, such as some pest categories are wrong and pest subjects are missing from the images. In this study, the IP102 data set was carefully filtered to obtain the HQIP102 data set, which contains 47,393 images of 102 pest classes on eight crops. The MADN model improves the representation capability of DenseNet in three aspects. Firstly, the Selective Kernel unit is introduced into the DenseNet model, which can adaptively adjust the size of the receptive field according to the input and capture target objects of different sizes more effectively. Secondly, in order to make the features obey a stable distribution, the Representative Batch Normalization module is used in the DenseNet model. In addition, adaptive selection of whether to activate neurons can improve the performance of the network, for which the ACON activation function is used in the DenseNet model. Finally, the MADN model is constituted by ensemble learning. Results: Experimental results show that MADN achieved an accuracy and F1Score of 75.28% and 65.46% on the HQIP102 data set, an improvement of 5.17 percentage points and 5.20 percentage points compared to the pre-improvement DenseNet-121. Compared with ResNet-101, the accuracy and F1Score of MADN model improved by 10.48 percentage points and 10.56 percentage points, while the parameters size decreased by 35.37%. Deploying models to cloud servers with mobile application provides help in securing crop yield and quality.
Pest24: A large-scale very small object data set of agricultural pests for multi-target detection

Qi-Jin Wang,Sheng-Yu Zhang,Shi-Feng Dong,Guang-Cai Zhang,Jin Yang,Rui Li,Hong-Qiang Wang

DOI: https://doi.org/10.1016/j.compag.2020.105585

IF: 8.3

2020-08-01

Computers and Electronics in Agriculture

Abstract:<p>Precision agriculture poses new challenges for real-time monitoring pest population in field based on new-generation AI technology. In order to provide a big data resource for training pest detection deep learning models, this paper establishes a large-scale multi-target standardized data set of agricultural pests, named Pest24. Specifically, the data set currently consists of 25,378 field pest annotated images collected from our automatic pest trap & imaging device. Totally, 24 categories of typical pests are involved in Pest24, which dominantly destroy field crops in China every year. We apply several state-of-the-art deep learning detection methods, Faster RCNN, SSD, YOLOv3, Cascade R-CNN to detect the pests in the data set, and obtain encouraging results for real-time monitoring field crop pests. To explore the factors that affect the detection accuracy of pests, we analyze the data set in a variety of aspects, finding that three factors, <em>i.e</em>. relative scale, number of instances and object adhesion, mainly influence the pest detection performance. Overall, Pest24 is featured typically with large scale multi-pest image data, very small object scales, high object similarity and dense pest distribution. We hope that Pest24 promotes accurate multi-pest monitoring for precision agriculture and also benefits the machine vision community by providing a new specialized object detection benchmark.</p>

agriculture, multidisciplinary,computer science, interdisciplinary applications
Non-Destructive Detection of Soybean Pest Based on Hyperspectral Image and Attention-ResNet Meta-Learning Model

Jiangsheng Gui,Huirong Xu,Jingyi Fei

DOI: https://doi.org/10.3390/s23020678

IF: 3.9

2023-01-07

Sensors

Abstract:Soybean plays an important role in food, medicine, and industry. The quality inspection of soybean is essential for soybean yield and the agricultural economy. However, soybean pest is an important factor that seriously affects soybean yield, among which leguminivora glycinivorella matsumura is the most frequent pest. Aiming at the problem that the traditional detection methods have low accuracy and need a large number of samples to train the model, this paper proposed a detection method for leguminivora glycinivorella matsumura based on an A-ResNet (Attention-ResNet) meta-learning model. In this model, the ResNet network was combined with Attention to obtain the feature vectors that can better express the samples, so as to improve the performance of the model. As well, the classifier was designed as a multi-class support vector machine (SVM) to reduce over-fitting. Furthermore, in order to improve the training stability of the model and the prediction performance on the testing set, the traditional Batch Normalization was replaced by the Layer Normalization, and the Label Smooth method was used to punish the original loss. The experimental results showed that the accuracy of the A-ResNet meta-learning model reached 94.57 ± 0.19%, which can realize rapid and accurate nondestructive detection, and provides theoretical support for the intelligent detection of soybean pests.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

Crop insect pest detection based on dilated multi-scale attention U-Net

Localization and recognition of pests in tea plantation based on image saliency analysis and convolutional neural network

Crop pest detection by three-scale convolutional neural network with attention

Attention-Based Multiscale Feature Pyramid Network for Corn Pest Detection under Wild Environment

Crop Pest Recognition in Real Agricultural Environment Using Convolutional Neural Networks by a Parallel Attention Mechanism

Image segmentation for pest detection of crop leaves by improvement of regional convolutional neural network

Cascaded Aggregation Convolution Network for Salient Grain Pests Detection

Based on the multi-scale information sharing network of fine-grained attention for agricultural pest detection

MULTI-TARGET DETECTION METHOD FOR MAIZE PESTS BASED ON IMPROVED YOLOv8

MSR-RCNN: A Multi-Class Crop Pest Detection Network Based on a Multi-Scale Super-Resolution Feature Enhancement Module

Detection of Rice Pests Based on Self-Attention Mechanism and Multi-Scale Feature Fusion

Pest-ConFormer: A Hybrid CNN-Transformer Architecture for Large-Scale Multi-Class Crop Pest Recognition

Rethinking the Crop Row Detection Pipeline: an End-to-end Method for Crop Row Detection Based on Row-Column Attention

FESNet: Frequency-Enhanced Saliency Detection Network for Grain Pest Segmentation

A Spatial Feature-Enhanced Attention Neural Network with High-Order Pooling Representation for Application in Pest and Disease Recognition

An Efficient Approach for Crops Pests Recognition and Classification Based on Novel DeepPestNet Deep Learning Model

MS-ALN: Multiscale Attention Learning Network for Pest Recognition

ESA-Net: An efficient scale-aware network for small crop pest detection

Crop pest image classification based on improved densely connected convolutional network

Pest24: A large-scale very small object data set of agricultural pests for multi-target detection

Non-Destructive Detection of Soybean Pest Based on Hyperspectral Image and Attention-ResNet Meta-Learning Model