Abstract:Crop pests are acknowledged as the major factors in reducing the yield and quality of agricultural production worldwide. It is an urgent necessity to recognize crop pests accurately to protect the crop in the early stage to reduce the loss for the agricultural economy. Due to the ecological characteristics of the crop pests and the complex background in fields, the crop pests show high inter-class similarity and significant intra-class variation in external morphology appearance, which makes current recognition methods suffer from low classification accuracy and poor generalization ability in complex natural environment recognition tasks. To tackle this problem, a hybrid convolutional neural network and transformer-based model, namely Pest-ConFormer, featured with multi-scale weakly supervised feature selection mechanisms is proposed, which has shown excellent multiscale discriminative feature extraction in fine-grained visual classification (FGVC) tasks. This method employs a hybrid convolution-transformer encoder architecture pre-training in a self-supervised masked autoencoder manner as a backbone to learn pests' highly discriminative features across various scales. Next, a dual-path feature aggregation structure with a top-down FPN-like feature pathway and a bottom-up PANet-like feature pathway based on attention mechanisms is designed to learn high-level global context information and low-level local detailed feature representation. Thirdly, a fine-grained classification module using weakly supervised learning is introduced to select the discriminative feature points in different pyramidal levels. Then, these feature points are fed into a graph convolutional network to accomplish classification. Several experiments are conducted on the large-scale multi-class IP102 benchmark dataset, and the proposed method achieves an accuracy of 77.81 % regarding crop pest recognition. The experimental results indicate that our approach outperforms other state-of-the-art methods by nearly 2 percent points, demonstrating that the proposed hybrid architecture with dual-path feature aggregation and fine-grained classification modules can be more effective in the crop pest recognition field than CNN-based methods and can be deployed in the practical natural environment. The source code will be available at https://github.com/mwfang/pestconformer.

A Coarse-to-fine Network for Aphid Recognition and Detection in the Field

TD-Det: A Tiny Size Dense Aphid Detection Network under In-Field Environment

A multi-branch convolutional neural network with density map for aphid counting

Aphid cluster recognition and detection in the wild using deep learning models

A New Dataset and Comparative Study for Aphid Cluster Detection

CRA-Net: A channel recalibration feature pyramid network for detecting small pests

Automatic Segmentation and Counting of Aphid Nymphs on Leaves Using Convolutional Neural Networks

A New Dataset and Comparative Study for Aphid Cluster Detection and Segmentation in Sorghum Fields

An Effective Data Augmentation Strategy for CNN-Based Pest Localization and Recognition in the Field

An Improved DenseNet Model to Classify the Damage Caused by Cotton Aphid.

Towards densely clustered tiny pest detection in the wild environment

Aphid Recognition and Counting Based on an Improved YOLOv5 Algorithm in a Climate Chamber Environment

Effective Insect Recognition Using a Stacked Autoencoder with Maximum Correntropy Criterion

Adaptive Feature Fusion Pyramid Network for Multi-Classes Agricultural Pest Detection

An effective pest detection method with automatic data augmentation strategy in the agricultural field

Pest-ConFormer: A Hybrid CNN-Transformer Architecture for Large-Scale Multi-Class Crop Pest Recognition

Insect Detection And Classification Based On An Improved Convolutional Neural Network

OSAF-Net: A one-stage anchor-free detector for small-target crop pest detection

Attention-Based Multiscale Feature Pyramid Network for Corn Pest Detection under Wild Environment

Recognition and counting of typical apple pests based on deep learning

An Efficient and Small Convolutional Neural Network for Pest Recognition -- ExquisiteNet