A Self-Iterative Learning with Dual Attention Mechanism Fusion Method for Pumpkin Seed Quality Equipment

Weiming Shi,Runzhe Zhang,Kui Xuan,Cong Wang,Huayu Fu,Longgang Zhao,Juan Li,Zhongzhi Han

DOI: https://doi.org/10.1016/j.engappai.2024.109446

2024-01-01

Abstract:To perform fast and accurate classification of pumpkin seeds, three batches of pumpkin seed images were taken. A self-iterative learning large kernel attention-Squeeze and Excitation-Residual Network34 (LKA-SE-ResNet34) model was proposed by adding dual attention mechanism fusion of large kernal attention (LKA) mechanism and Squeeze and Excitation (SE) attention mechanism to each residual module of ResNet34 for recognizing pumpkin seeds. ResNet34 network model was chosen as the basic framework by comparing GoogleNet, AlexNet, EfficientNet, MobileNet, DenseNet, ResNet34 and Residual Network50 (ResNet50) deep learning network models. The comparation result showed that the top two models with the highest accuracy (Acc) are ResNet50 network model and ResNet34 network model among the compared models. The experimental results showed that the selfiterative learning LKA-SE-ResNet34 model outperformed the above-mentioned other network models in pumpkin seed recognition with an accuracy of 91.8%. To further validate the effectiveness of the proposed model for small sample size of data, two-sided images and deformed images of pumpkin seeds were collected and used, and the experimental results still proved that the proposed model had good generalization ability and accuracy, with the accuracies of 93.63% and 94.15% for two sides of pumpkin seeds as well as an accuracy of 99.03% for deformed pumpkin seeds. A set of seed sorting machine and an application (APP) for non-destructive testing of seeds were initially developed.