Diagnostic quiz #44. Case no. 2. Odontoma.

R. Baughman,R. Snyders,S. Guelff

2000-10-01

Abstract:

What problem does this paper attempt to address?

Trap colour strongly affects the ability of deep learning models to recognize insect species in images of sticky traps

Song-Quan Ong,Toke Thomas Høye

DOI: https://doi.org/10.1002/ps.8464

2024-10-08

Abstract:Background: The use of computer vision and deep learning models to automatically classify insect species on sticky traps has proven to be a cost- and time-efficient approach to pest monitoring. As different species are attracted to different colours, the variety of sticky trap colours poses a challenge to the performance of the models. However, the effectiveness of deep learning in classifying pests on different coloured sticky traps has not yet been sufficiently explored. In this study, we aim to investigate the influence of sticky trap colour and imaging devices on the performance of deep learning models in classifying pests on sticky traps. Results: Our results show that using the MobileNetV2 architecture with transparent sticky traps as training data, the model predicted the pest species on transparent sticky traps with an accuracy of at least 0.95 and on other sticky trap colours with at least 0.85 of the F1 score. Using a generalised linear model (GLM) and a Boruta feature selection algorithm, we also showed that the colour and architecture of the sticky traps significantly influenced the performance of the model. Conclusion: Our results support the development of an automatic classification of pests on a sticky trap, which should focus on colour and deep learning architecture to achieve good results. Future studies could aim to incorporate the trap system into pest monitoring, providing more accurate and cost-effective results in a pest management programme. © 2024 The Author(s). Pest Management Science published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry.
Localization and recognition of pests in tea plantation based on image saliency analysis and convolutional neural network

Yang Guoguo,Bao Yidan,Liu Ziyi

DOI: https://doi.org/10.11975/j.issn.1002-6819.2017.06.020

2017-01-01

Abstract:Tea is one of important cash crops in China. Computer vision plays an important role in pest detection. Automatic classification of insect species in field is more difficult than the generic object classification because of complex background in filed and high appearance similarity among insect species. In this paper, we proposed an insect recognition system on the basis of image saliency analysis and a deep learning model, i.e. convolutional neural network (CNN), which has a good robustness with avoiding the features selected by artificial means. In image saliency analysis, we segmented the original images into super-pixel regions firstly. Then we quantized each RGB (red, green, blue) color channel and made them have 10 different values, which reduced the number of colors to 1000, and sped up the process of the color contrast of the pest objects and the background at region level. Finally, we obtained the saliency value of each region by combining their color contrast and spatial distances. The saliency values of all regions in each image were used to construct a saliency map, which was offered as the initial area for GrabCut algorithm to define the segmentation result and localize the pest object. The images after localization were quantized to 256×256 dpi for CNN training and classifying. CNN was trained end to end, from raw pixels to ultimate categories, thereby alleviating the requirement to manually design a suitable feature extractor. Based on theoretical analysis and experimental evaluation, we optimized the critical structure parameters and training strategy of CNN to seek the best configuration. The overall architecture included a number of sensitive parameters and optimization strategies that could be changed. We determined the local receptive field size, number, and convolutional stride as 7×7 dpi, 64 and 4, respectively. Dropout ratio for the fully-connected layers was 0.7. The loss function Softmax was fit for the pest classification system. To further improve the practical utility of CNN, we focused on structural changes of the overall architecture that enabled a faster running with small effects on the performance. We analyzed the performance and the corresponding runtime of our model by reducing its depth (number of layers) and width (number of convolution kernel in each layer). Removing the fully-connected layers (FC6, FC7) made only a slight difference to the overall architecture. These layers contained almost 90% of the parameters and when they were removed, the memory consumption decreased to 29.8 MB. But, removing the intermediate convolutional layers (Conv2, Conv3, Conv4, Conv5) resulted in a dramatic decrease in both accuracy and runtime. This suggested that the intermediate convolutional layers (Conv2, Conv3, Conv4, Conv5) constituted the main part of the computational resource, and their depth was important for achieving good results. We then investigated the effects of adjusting the sizes of all convolutional layers, and the filters in each convolutional layer were reduced to 64 each time. Surprisingly, all architectures showed significant decreases in running time with relatively small effects on performance. Finally, we determined the convolution kernel numbers of Conv2-Conv5: 64-192-192-64. On the test set of tea field images, the architecture before and after shrinking respectively achieved the average accuracy (AA) of 0.915 and 0.881, respectively, superior to previous methods for pest image recognition. Further, after optimization the running time reduced to 0.7 ms and the memory required was 6 MB.
Detection of Small-Sized Insects in Sticky Trapping Images Using Spectral Residual Model and Machine Learning

Wenyong Li,Zhankui Yang,Jiawei Lv,Tengfei Zheng,Ming Li,Chuanheng Sun

DOI: https://doi.org/10.3389/fpls.2022.915543

2022-06-28

Abstract:One fundamental component of Integrated pest management (IPM) is field monitoring and growers use information gathered from scouting to make an appropriate control tactics. Whitefly (Bemisia tabaci) and thrips (Frankliniella occidentalis) are two most prominent pests in greenhouses of northern China. Traditionally, growers estimate the population of these pests by counting insects caught on sticky traps, which is not only a challenging task but also an extremely time-consuming one. To alleviate this situation, this study proposed an automated detection approach to meet the need for continuous monitoring of pests in greenhouse conditions. Candidate targets were firstly located using a spectral residual model and then different color features were extracted. Ultimately, Whitefly and thrips were identified using a support vector machine classifier with an accuracy of 93.9 and 89.9%, a true positive rate of 93.1 and 80.1%, and a false positive rate of 9.9 and 12.3%, respectively. Identification performance was further tested via comparison between manual and automatic counting with a coefficient of determination, R 2, of 0.9785 and 0.9582. The results show that the proposed method can provide a comparable performance with previous handcrafted feature-based methods, furthermore, it does not require the support of high-performance hardware compare with deep learning-based method. This study demonstrates the potential of developing a vision-based identification system to facilitate rapid gathering of information pertaining to numbers of small-sized pests in greenhouse agriculture and make a reliable estimation of overall population density.
Construction of a Dataset of Stored-grain Insects Images for Intelligent Monitoring

Jiangtao Li,Huiling Zhou,Digvir S. Jayas,Qingxuan Jia

DOI: https://doi.org/10.13031/aea.13122

2019-01-01

Applied Engineering in Agriculture

Abstract:Abstract. We constructed an image dataset of adults of 10 common species of stored-grain insects. This dataset is very significant for the research on image recognition algorithms for stored-grain insects, in order to implement intelligent monitoring for insects in warehouses. Images were collected using two kinds of devices: a developed automatic insect image acquisition device that can be fitted with different traps in warehouses and the commonly used smart phones. The images in this dataset contained 10 species of insect instances with various sizes, poses, and orientations. Each image corresponded to an xml file to store the species names and bounding boxes of insect instances in images. In total, 3,757 images were collected, and 159,238 insect instances were marked. The fine-grained classification algorithm based on Bilinear CNN and the object detection algorithms based on Faster R-CNN were adopted as baseline algorithms for benchmark experiments. Experiment results indicated that this dataset could support the research of image recognition algorithms of stored-grain insects, but it is a challenging task to detect small, adhesive and overlapped insect instances in images of this dataset. Currently, this dataset can be accessed at rgbinsect.cn. Keywords: Bilinear CNN, Faster R-CNN, Image dataset, Image recognition, Monitoring, Stored-grain Insects.

agricultural engineering
Automatic moth detection from trap images for pest management

Weiguang Ding,Graham Taylor

DOI: https://doi.org/10.1016/j.compag.2016.02.003

IF: 8.3

2016-04-01

Computers and Electronics in Agriculture

Abstract:Monitoring the number of insect pests is a crucial component in pheromone-based pest management systems. In this paper, we propose an automatic detection pipeline based on deep learning for identifying and counting pests in images taken inside field traps. Applied to a commercial codling moth dataset, our method shows promising performance both qualitatively and quantitatively. Compared to previous attempts at pest detection, our approach uses no pest-specific engineering which enables it to adapt to other species and environments with minimal human effort. It is amenable to implementation on parallel hardware and therefore capable of deployment in settings where real-time performance is required.

agriculture, multidisciplinary,computer science, interdisciplinary applications
Field pest monitoring and forecasting system for pest control

Chengkang Liu,Zhiqiang Zhai,Ruoyu Zhang,Jingya Bai,Mengyun Zhang

DOI: https://doi.org/10.3389/fpls.2022.990965

2022-08-29

Abstract:Insect pest is an essential factor affecting crop yield, and the effect of pest control depends on the timeliness and accuracy of pest forecasting. The traditional method forecasts pest outbreaks by manually observing (capturing), identifying, and counting insects, which is very time-consuming and laborious. Therefore, developing a method that can more timely and accurately identify insects and obtain insect information. This study designed an image acquisition device that can quickly collect real-time photos of phototactic insects. A pest identification model was established based on a deep learning algorithm. In addition, a model update strategy and a pest outbreak warning method based on the identification results were proposed. Insect images were processed to establish the identification model by removing the background; a laboratory image collection test verified the feasibility. The results showed that the proportion of images with the background completely removed was 90.2%. Dataset 1 was obtained using reared target insects, and the identification accuracy of the ResNet V2 model on the test set was 96%. Furthermore, Dataset 2 was obtained in the cotton field using a designed field device. In exploring the model update strategy, firstly, the T_ResNet V2 model was trained with Dataset 2 using transfer learning based on the ResNet V2 model; its identification accuracy on the test set was 84.6%. Secondly, after reasonably mixing the indoor and field datasets, the SM_ResNet V2 model had an identification accuracy of 85.7%. The cotton pest image acquisition, transmission, and automatic identification system provide a good tool for accurately forecasting pest outbreaks in cotton fields.
A New Dataset and Comparative Study for Aphid Cluster Detection

Tianxiao Zhang,Kaidong Li,Xiangyu Chen,Cuncong Zhong,Bo Luo,Ivan Grijalva Teran,Brian McCornack,Daniel Flippo,Ajay Sharda,Guanghui Wang

DOI: https://doi.org/10.48550/arXiv.2307.05929

2023-07-12

Abstract:Aphids are one of the main threats to crops, rural families, and global food security. Chemical pest control is a necessary component of crop production for maximizing yields, however, it is unnecessary to apply the chemical approaches to the entire fields in consideration of the environmental pollution and the cost. Thus, accurately localizing the aphid and estimating the infestation level is crucial to the precise local application of pesticides. Aphid detection is very challenging as each individual aphid is really small and all aphids are crowded together as clusters. In this paper, we propose to estimate the infection level by detecting aphid clusters. We have taken millions of images in the sorghum fields, manually selected 5,447 images that contain aphids, and annotated each aphid cluster in the image. To use these images for machine learning models, we crop the images into patches and created a labeled dataset with over 151,000 image patches. Then, we implement and compare the performance of four state-of-the-art object detection models.

Computer Vision and Pattern Recognition,Artificial Intelligence
Psyllid Detector: A Web-Based Application to Automate Insect Detection Utilizing Image Processing and Deep Learning

Vitor Andrade Gontijo da Cunha,Dyllan Andrew Pullock,Mohamed Ali,Antonio de Oliveira Costa Neto,Yiannis Ampatzidis,Christopher William Weldon,Kerstin Kruger,Aruna Manrakhan,Jawwad Qureshi

DOI: https://doi.org/10.13031/aea.15826

2024-01-01

Applied Engineering in Agriculture

Abstract:Highlights An AI-enabled web application was developed to classify insects on sticky traps. The AI models were trained on images exposed to real environmental conditions. Automated insect identification can enhance integrated pest management. This technology could be used in other environmental applications. Abstract. The Huanglongbing (HLB) disease has had a devastating impact on several citrus production areas across the world. The disease is associated with three phloem-limited bacteria of the Candidatus Liberibacter group, which can be vectored by citrus-infesting psyllids. In Florida, it is vectored by Diaphorina citri, also known as Asian citrus psyllid (ACP), and in South Africa, by a native species, Trioza erytreae, or African citrus triozid (ACT). For better disease management, continued monitoring of these vectors is highly recommended. Furthermore, it is important to keep track of other related psyllids that reside in citrus environments (e.g., the South African native Diaphorina specimens DN, such as D. virgata, D. punctulata, and D. zebrana), as well as natural predators of psyllids (e.g., lady beetles, LB). Among the tools used to monitor pests in the field, sticky traps are one of the most common and widely used. Analyzing the traps and identifying the specimens of interest usually require specialized personnel, which can be costly and time-consuming. In an effort to automate this process, a web application called “Psyllid Detector” was developed. Three YOLOv7-based object detection algorithms (YOLOv7, YOLOv7-ResNet50, and YOLOv7-ResNeXt50) were selected to train six models using two datasets (South Africa and Florida datasets) composed of yellow sticky trap pictures taken from several citrus orchards. Three models were trained to detect ACP and LB using the Florida dataset, and three were trained to detect DN and ACT in the South Africa dataset. The models trained with the original YOLOv7 for both datasets showed the best overall results. For example, for the ACT detection in the South Africa dataset, precision, recall, and F1 scores of 90%, 70%, and 79% were achieved, respectively. By automating the process of insect detection, farmers can save time and resources and make informed decisions about pest control measures. Keywords: ACP, ACT, Huanglongbing, Machine learning, Object detection, YOLO.

agricultural engineering
Comprehensive wheat coccinellid detection dataset: Essential resource for digital entomology

Ivan Grijalva,Nicholas Clark,Emma Hamilton,Carson Orpin,Carmen Perez,James Schaefer,Kaylynn Vogts,Brian McCornack

DOI: https://doi.org/10.1016/j.dib.2024.110585

2024-06-04

Abstract:Wheat (Triticum aestivum) is a major cereal crop planted in the Southern Great Plains. This crop faces diverse pests that can affect their development and reduce yield productivity. For example, aphids are a significant pest in wheat, and their management relies on pesticides, which affect the sustainability and biodiversity of natural predators that prey on aphids. Coccinellids, commonly named lady beetles, are the most abundant natural predators of wheat. These natural enemies contribute to the natural predation of aphids, which can reduce the use of excessive pesticides for aphid management. Usually, visual observations of these natural enemies are performed during pest sampling; however, it is time-consuming and requires manual labor, which can be expensive. An automation system or detection models based on machine learning approaches that can detect these insects is needed to reduce unnecessary pesticide applications and manual labor costs. However, developing an automation system or computer vision models that automatically detect these natural enemies requires imagery to train and validate this cutting-edge technology. To solve this research problem, we collected this dataset, which includes images and label annotations to help researchers and students develop this technology that can benefit wheat growers and science to understand the capabilities of automation in Entomology. We collected a dataset using mobile devices, which included a diverse range of coccinellids on wheat images. The dataset consists of 2,133 images with a standard size of 640 × 640 pixels, which can be used to train and develop detection models for machine learning purposes. In addition, the dataset includes annotated labels that can be used for training models within the YOLO family or others, which have been proven to detect small insects in crops. Our dataset will increase the understanding of machine learning capabilities in entomology, precision agriculture, education, and crop pest management decisions.
Image detection model construction of Apolygus lucorum and Empoasca spp. based on improved YOLOv5

Bo Xiong,Delu Li,Qi Zhang,Nicolas Desneux,Chen Luo,Zuqing Hu

DOI: https://doi.org/10.1002/ps.7964

Abstract:Background: The polyphagous mirid bug Apolygus lucorum (Meyer-Dür) and the green leafhopper Empoasca spp. Walsh are small pests that are widely distributed and important pests of many economically important crops, especially kiwis. Conventional monitoring methods are expensive, laborious and error-prone. Currently, deep learning methods are ineffective at recognizing them. This study proposes a new deep-learning-based YOLOv5s_HSSE model to automatically detect and count them on sticky card traps. Results: Based on a database of 1502 images, all images were collected from kiwi orchards at multiple locations and times. We trained the YOLOv5s model to detect and count them and then changed the activation function to Hard swish in YOLOv5s, introduced the SIoU Loss function, and added the squeeze-and-excitation attention mechanism to form a new YOLOv5s_HSSE model. Mean average precision of this model in the test dataset was 95.9%, the recall rate was 93.9% and the frames per second was 155, which are higher than those of other single-stage deep-learning models, such as SSD, YOLOv3 and YOLOv4. Conclusion: The proposed YOLOv5s_HSSE model can be used to identify and count A. lucorum and Empoasca spp., and it is a new, efficient and accurate monitoring method. Pest detection will benefit from the broader applications of deep learning. © 2024 Society of Chemical Industry.
Development of a deep learning model from breeding substrate images: a novel method for estimating the abundance of house fly (Musca domestica L.) larvae

Song-Quan Ong,Hamdan Ahmad,Abdul Hafiz Ab Majid

DOI: https://doi.org/10.1002/ps.6573

Abstract:Background: The application of computer vision and deep learning to pest monitoring has recently received much attention. Although several studies have demonstrated the application of object detection to the number of pests on a substrate, for house flies (Musca domestica L.), in which the larvae were aggregated and overlapped together, the object detection technique was difficult to implement. We demonstrate a novel method for estimating larval abundance by using computer vision on larval breeding substrate, in which the reflective color and topography are affected by the size of the population. Results: We demonstrate a method using a web-based tool to construct a deep learning model and later export the model for deployment. We train the model by using breeding substrate images with different spectra of illumination on known densities of larvae and evaluate the training model in both the test set and field-collected samples. In general, the model was able to predict the larval abundance by the laboratory-prepared breeding substrate with 87.56% to 94.10% accuracy, precision, recall, and F-score on the unseen test set, and white and green illumination performed significantly higher compared to other illuminations. For field samples, the model was able to obtain at least 70% correct predictions by using white and infrared illumination. Conclusion: Larval abundance can be monitored with computer vision and deep learning, and the monitoring can be improved by using more biochemistry parameters as the predictors and examples of field samples included building a more robust model. © 2021 Society of Chemical Industry.
Pest24: A large-scale very small object data set of agricultural pests for multi-target detection

Qi-Jin Wang,Sheng-Yu Zhang,Shi-Feng Dong,Guang-Cai Zhang,Jin Yang,Rui Li,Hong-Qiang Wang

DOI: https://doi.org/10.1016/j.compag.2020.105585

IF: 8.3

2020-08-01

Computers and Electronics in Agriculture

Abstract:<p>Precision agriculture poses new challenges for real-time monitoring pest population in field based on new-generation AI technology. In order to provide a big data resource for training pest detection deep learning models, this paper establishes a large-scale multi-target standardized data set of agricultural pests, named Pest24. Specifically, the data set currently consists of 25,378 field pest annotated images collected from our automatic pest trap & imaging device. Totally, 24 categories of typical pests are involved in Pest24, which dominantly destroy field crops in China every year. We apply several state-of-the-art deep learning detection methods, Faster RCNN, SSD, YOLOv3, Cascade R-CNN to detect the pests in the data set, and obtain encouraging results for real-time monitoring field crop pests. To explore the factors that affect the detection accuracy of pests, we analyze the data set in a variety of aspects, finding that three factors, <em>i.e</em>. relative scale, number of instances and object adhesion, mainly influence the pest detection performance. Overall, Pest24 is featured typically with large scale multi-pest image data, very small object scales, high object similarity and dense pest distribution. We hope that Pest24 promotes accurate multi-pest monitoring for precision agriculture and also benefits the machine vision community by providing a new specialized object detection benchmark.</p>

agriculture, multidisciplinary,computer science, interdisciplinary applications
AgriPest: A Large-Scale Domain-Specific Benchmark Dataset for Practical Agricultural Pest Detection in the Wild

Rujing Wang,Liu Liu,Chengjun Xie,Po Yang,Rui Li,Man Zhou

DOI: https://doi.org/10.3390/s21051601

IF: 3.9

2021-02-25

Sensors

Abstract:The recent explosion of large volume of standard dataset of annotated images has offered promising opportunities for deep learning techniques in effective and efficient object detection applications. However, due to a huge difference of quality between these standardized dataset and practical raw data, it is still a critical problem on how to maximize utilization of deep learning techniques in practical agriculture applications. Here, we introduce a domain-specific benchmark dataset, called AgriPest, in tiny wild pest recognition and detection, providing the researchers and communities with a standard large-scale dataset of practically wild pest images and annotations, as well as evaluation procedures. During the past seven years, AgriPest captures 49.7K images of four crops containing 14 species of pests by our designed image collection equipment in the field environment. All of the images are manually annotated by agricultural experts with up to 264.7K bounding boxes of locating pests. This paper also offers a detailed analysis of AgriPest where the validation set is split into four types of scenes that are common in practical pest monitoring applications. We explore and evaluate the performance of state-of-the-art deep learning techniques over AgriPest. We believe that the scale, accuracy, and diversity of AgriPest can offer great opportunities to researchers in computer vision as well as pest monitoring applications.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Thrips Detection and Monitoring System in Mango Greenhouses Based on Deep Learning Image Recognition

Ge-Han Wu,Nen-Fu Huang,Yu-Hsiang Huang,Pin-Cheng Chan,Showkat Ahmad Bhat

DOI: https://doi.org/10.1109/tim.2024.3403191

IF: 5.6

2024-06-07

IEEE Transactions on Instrumentation and Measurement

Abstract:The ability of thrips to infect plants with viruses, oviposition, and feeding makes it one of the most damaging agricultural pests in the world. Due to their invasiveness, many pest species pose serious challenges to growers of a wide variety of crops especially Mango in both open fields and greenhouses globally. For detecting various pests, sticky paper traps have been widely used. It is essential to inspect sticky paper traps as part of an integrated pest management (IPM) process. Identification and counting the pests caught in the traps is a laborious process. A timely and effective strategy is therefore required to resolve the issue. This study proposes and develops a complete and feasible integrated pest detection and monitoring system (IPDMS) by combining an ultrahigh resolution pest monitoring device coupled with a deep learning-based object detection model. The developed system was able to collect sticky paper images with a resolution of 64 megapixels and an AWS database for analysis. Test results from two Mango greenhouses show that the model can detect thrips with 90% accuracy and an -score of 0.95. Additionally, a web-based user interface was developed to provide visual image recognition results and thrip population analysis. Thus, the proposed IPDMS addresses the significant problems with pest detection systems (PDSs) by providing real-time information on pest occurrences in greenhouses. Thus, it makes pest detection and monitoring in agriculture efficient.

engineering, electrical & electronic,instruments & instrumentation
Insect Identification in the Wild: The AMI Dataset

Aditya Jain,Fagner Cunha,Michael James Bunsen,Juan Sebastián Cañas,Léonard Pasi,Nathan Pinoy,Flemming Helsing,JoAnne Russo,Marc Botham,Michael Sabourin,Jonathan Fréchette,Alexandre Anctil,Yacksecari Lopez,Eduardo Navarro,Filonila Perez Pimentel,Ana Cecilia Zamora,José Alejandro Ramirez Silva,Jonathan Gagnon,Tom August,Kim Bjerge,Alba Gomez Segura,Marc Bélisle,Yves Basset,Kent P. McFarland,David Roy,Toke Thomas Høye,Maxim Larrivée,David Rolnick

2024-09-30

Abstract:Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack of scalable tools for monitoring. Ecologists have started to adopt camera traps to record and study insects, and have proposed computer vision algorithms as an answer for scalable data processing. However, insect monitoring in the wild poses unique challenges that have not yet been addressed within computer vision, including the combination of long-tailed data, extremely similar classes, and significant distribution shifts. We provide the first large-scale machine learning benchmarks for fine-grained insect recognition, designed to match real-world tasks faced by ecologists. Our contributions include a curated dataset of images from citizen science platforms and museums, and an expert-annotated dataset drawn from automated camera traps across multiple continents, designed to test out-of-distribution generalization under field conditions. We train and evaluate a variety of baseline algorithms and introduce a combination of data augmentation techniques that enhance generalization across geographies and hardware setups.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Motion Informed Object Detection of Small Insects in Time-lapse Camera Recordings

Kim Bjerge,Carsten Eie Frigaard,Henrik Karstoft

2023-06-29

Abstract:Insects as pollinators play a crucial role in ecosystem management and world food production. However, insect populations are declining, calling for efficient methods of insect monitoring. Existing methods analyze video or time-lapse images of insects in nature, but the analysis is challenging since insects are small objects in complex and dynamic scenes of natural vegetation. In this work, we provide a dataset of primary honeybees visiting three different plant species during two months of the summer period. The dataset consists of 107,387 annotated time-lapse images from multiple cameras, including 9,423 annotated insects. We present a method pipeline for detecting insects in time-lapse RGB images. The pipeline consists of a two-step process. Firstly, the time-lapse RGB images are preprocessed to enhance insects in the images. This Motion-Informed-Enhancement technique uses motion and colors to enhance insects in images. Secondly, the enhanced images are subsequently fed into a Convolutional Neural network (CNN) object detector. The method improves the deep learning object detectors You Only Look Once (YOLO) and Faster Region-based CNN (Faster R-CNN). Using Motion-Informed-Enhancement, the YOLO-detector improves the average micro F1-score from 0.49 to 0.71, and the Faster R-CNN-detector improves the average micro F1-score from 0.32 to 0.56 on the dataset. Our dataset and proposed method provide a step forward to automate the time-lapse camera monitoring of flying insects. The dataset is published on: <a class="link-external link-https" href="https://vision.eng.au.dk/mie/" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Artificial Intelligence
New image dataset and new negative sample judgment method for crop pest recognition based on deep learning models

Kaili Wang,Keyu Chen,Huiyu Du,Shuang Liu,Jingwen Xu,Junfang Zhao,Houlin Chen,Yujun Liu,Yang Liu

DOI: https://doi.org/10.1016/j.ecoinf.2022.101620

IF: 5.1

2022-07-01

Ecological Informatics

Abstract:Crop pests are responsible for serious economic loss around the worldwide. Accurate recognition of pests is the key to pest control and is a considerable challenge in farming. Deep learning models have shown great promise in image recognition, drawing the attention of many agricultural experts. However, the lack of pest image datasets and the inexplicability of deep learning models have hindered the development of deep learning models in the field of pest recognition. Our work provides the following four contributions: (1) We constructed a new and more effective dataset, for crop pest recognition, named IP41 comprising 46,567 original images of crop pests in 41 classes. (2) We trained three different deep learning models based on IP41, using transfer learning combined with fine-tuning. The results of the three deep learning models exceeded 80.00% recognition. (3) A negative sample judgment method was proposed to exclude the uploaded pest-free images of the user. (4) We provided reasonable visual explanations for the most critical areas of the recognition layers by using the gradient-weighted class activation mapping method. This research suggests that the recognition process focuses more on image details than the image as a whole, and that overall difference is ignored to a certain extent. These results will be helpful to future research in the field of agricultural pest recognition

ecology
Aphid cluster recognition and detection in the wild using deep learning models

Tianxiao Zhang,Kaidong Li,Xiangyu Chen,Cuncong Zhong,Bo Luo,Ivan Grijalva,Brian McCornack,Daniel Flippo,Ajay Sharda,Guanghui Wang

DOI: https://doi.org/10.1038/s41598-023-38633-5

IF: 4.6

2023-08-19

Scientific Reports

Abstract:Aphid infestation poses a significant threat to crop production, rural communities, and global food security. While chemical pest control is crucial for maximizing yields, applying chemicals across entire fields is both environmentally unsustainable and costly. Hence, precise localization and management of aphids are essential for targeted pesticide application. The paper primarily focuses on using deep learning models for detecting aphid clusters. We propose a novel approach for estimating infection levels by detecting aphid clusters. To facilitate this research, we have captured a large-scale dataset from sorghum fields, manually selected 5447 images containing aphids, and annotated each individual aphid cluster within these images. To facilitate the use of machine learning models, we further process the images by cropping them into patches, resulting in a labeled dataset comprising 151,380 image patches. Then, we implemented and compared the performance of four state-of-the-art object detection models (VFNet, GFLV2, PAA, and ATSS) on the aphid dataset. Extensive experimental results show that all models yield stable similar performance in terms of average precision and recall. We then propose to merge close neighboring clusters and remove tiny clusters caused by cropping, and the performance is further boosted by around 17%. The study demonstrates the feasibility of automatically detecting and managing insects using machine learning models. The labeled dataset will be made openly available to the research community.

multidisciplinary sciences
Pest Identification using Image Processing Techniques in Detecting Image Pattern through Neural Network

Johnny L. Miranda,Bobby D. Gerardo,Bartolome T. Tanguilig

Abstract:In rice production, pest invasion is considered as the most challenging task for crop technicians and farmers. Pest invasion can cause serious losses and affect the income of farmers. It is then important to assess their density for pests forecasting decision making. Existing identification techniques of these species comprise of using different traps to detect their presence. However, these traditional methods are labor-intensive and sometimes experts on this field are not available. Another problem is that multiple site and frequent monitoring of rice pests is time consuming and tedious for a crop technician. This can lead to low accuracy and delays in obtaining accurate count of these species. In this study, an identification system was developed to automatically identify the insect pests in the paddy field. Sticky trap was used to capture the insect which continuously monitored by a wireless camera to record the video. Different image processing techniques was utilized to detect and extract the captured insect from the image, and Kohonen Self Organizing Maps neural network was used to identify the extracted insect pests. The results indicate that the proposed automated identification system is capable of accurately identifying the insect pests even though there are lots of lighting variations. The new automated identification system developed in this study provides a reliable identification and was found to be faster than a human expert in identifying the insect pests caught by a sticky trap.

Agricultural and Food Sciences,Engineering,Computer Science
Classification Method of Significant Rice Pests Based on Deep Learning

Zhiyong Li,Xueqin Jiang,Xinyu Jia,Xuliang Duan,Yuchao Wang,Jiong Mu

DOI: https://doi.org/10.3390/agronomy12092096

2022-09-01

Agronomy

Abstract:Rice pests are one of the main factors affecting rice yield. The accurate identification of pests facilitates timely preventive measures to avoid economic losses. Some existing open source datasets related to rice pest identification mostly include only a small number of samples, or suffer from inter-class and intra-class variance and data imbalance challenges, which limit the application of deep learning techniques in the field of rice pest identification. In this paper, based on the IP102 dataset, we first reorganized a large-scale dataset for rice pest identification by Web crawler technique and manual screening. This dataset was given the name IP_RicePests. Specifically, the dataset includes 8248 images belonging to 14 categories. The IP_RicePests dataset was then expanded to include 14,000 images via ARGAN data augmentation technique to address the difficulties in obtaining large samples of rice pests. Finally, the parameters trained on the public image ImageNet dataset using VGGNet, ResNet and MobileNet networks were used as the initial values of the target data training network to achieve image classification in the field of rice pests. The experimental results show that all three classification networks combined with transfer learning have good recognition accuracy, among which the highest classification accuracy can be obtained on the IP_RicePests dataset via fine-tuning the parameters of the VGG16 network. In addition, following ARGAN data augmentation the dataset demonstrates high accuracy improvements in all three models, and fine-tuning the VGG16 network parameters obtains the highest accuracy in the augmented IP_RicePests dataset. It is demonstrated that CNN combined with transfer learning can employ the ARGAN data augmentation technique to overcome difficulties in obtaining large sample sizes and improve the efficiency of rice pest identification. This study provides foundational data and technical support for rice pest identification.

plant sciences,agronomy

Diagnostic quiz #44. Case no. 2. Odontoma.

Trap colour strongly affects the ability of deep learning models to recognize insect species in images of sticky traps

Localization and recognition of pests in tea plantation based on image saliency analysis and convolutional neural network

Detection of Small-Sized Insects in Sticky Trapping Images Using Spectral Residual Model and Machine Learning

Construction of a Dataset of Stored-grain Insects Images for Intelligent Monitoring

Automatic moth detection from trap images for pest management

Field pest monitoring and forecasting system for pest control

A New Dataset and Comparative Study for Aphid Cluster Detection

Psyllid Detector: A Web-Based Application to Automate Insect Detection Utilizing Image Processing and Deep Learning

Comprehensive wheat coccinellid detection dataset: Essential resource for digital entomology

Image detection model construction of Apolygus lucorum and Empoasca spp. based on improved YOLOv5

Development of a deep learning model from breeding substrate images: a novel method for estimating the abundance of house fly (Musca domestica L.) larvae

Pest24: A large-scale very small object data set of agricultural pests for multi-target detection

AgriPest: A Large-Scale Domain-Specific Benchmark Dataset for Practical Agricultural Pest Detection in the Wild

Thrips Detection and Monitoring System in Mango Greenhouses Based on Deep Learning Image Recognition

Insect Identification in the Wild: The AMI Dataset

Motion Informed Object Detection of Small Insects in Time-lapse Camera Recordings

New image dataset and new negative sample judgment method for crop pest recognition based on deep learning models

Aphid cluster recognition and detection in the wild using deep learning models

Pest Identification using Image Processing Techniques in Detecting Image Pattern through Neural Network

Classification Method of Significant Rice Pests Based on Deep Learning