Abstract:Deep learning has become a widely used powerful tool in many research fields, although not much so yet in agriculture technologies. In this work, two deep convolutional neural networks (CNN), viz. Residual Network (ResNet) and its improved version named ResNeXt, are used to detect internal mechanical damage of blueberries using hyperspectral transmittance data. The original structure and size of hypercubes are adapted for the deep CNN training. To ensure that the models are applicable to hypercube, we adjust the number of filters in the convolutional layers. Moreover, a total of 5 traditional machine learning algorithms, viz. Sequential Minimal Optimization (SMO), Linear Regression (LR), Random Forest (RF), Bagging and Multilayer Perceptron (MLP), are performed as the comparison experiments. In terms of model assessment, k-fold cross validation is used to indicate that the model performance does not vary with the different combination of dataset. In real-world application, selling damaged berries will lead to greater interest loss than discarding the sound ones. Thus, precision, recall, and F1-score are also used as the evaluation indicators alongside accuracy to quantify the false positive rate. The first three indicators are seldom used by investigators in the agricultural engineering domain. Furthermore, ROC curves and Precision-Recall curves are plotted to visualize the performance of classifiers. The fine-tuned ResNet/ResNeXt achieve average accuracy and F1-score of 0.8844/0.8784 and 0.8952/0.8905, respectively. Classifiers SMO/ LR/RF/Bagging/MLP obtain average accuracy and F1-score of 0.8082/0.7606/0.7314/0.7113/0.7827 and 0.8268/0.7796/0.7529/0.7339/0.7971, respectively. Two deep learning models achieve better classification performance than the traditional machine learning methods. Classification for each testing sample only takes 5.2 ms and 6.5 ms respectively for ResNet and ResNeXt, indicating that the deep learning framework has great potential for online fruit sorting. The results of this study demonstrate the potential of deep CNN application on analyzing the internal mechanical damage of fruit.

Pixel-wise Mechanical Damage Detection of Waxy Maize Using Spectral–spatial Feature Extraction and Hyperspectral Image

Non-destructive detection of defective maize kernels using hyperspectral imaging and convolutional neural network with attention module

Cost-sensitive stacked sparse auto-encoder models to detect striped stem borer infestation on rice based on hyperspectral imaging

Identification of Defective Maize Seeds Using Hyperspectral Imaging Combined with Deep Learning

Classification of Frozen Corn Seeds Using Hyperspectral VIS/NIR Reflectance Imaging

Detection of Insect-Damaged Maize Seed Using Hyperspectral Imaging and Hybrid 1D-CNN-BiLSTM Model

Corn Seed Variety Classification Based on Hyperspectral Reflectance Imaging and Deep Convolutional Neural Network

Hyperspectral Reflectance Imaging for Detecting Typical Defects of Durum Kernel Surface

Detection of the moldy status of the stored maize kernels using hyperspectral imaging and deep learning algorithms

Hyperspectral detection of fresh corn peeling damage using germinating sparse classification method

Maize disease detection based on spectral recovery from RGB images

Nondestructive Classification of Maize Moldy Seeds by Hyperspectral Imaging and Optimal Machine Learning Algorithms

Determination of Damaged Wheat Kernels with Hyperspectral Imaging Analysis

Identification of Corn Seeds with Different Freezing Damage Degree Based on Hyperspectral Reflectance Imaging and Deep Learning Method

Detection of Water Content in Corn Based on Hyperspectral Imaging and Neural Network

Application of Deep Learning Architectures for Accurate and Rapid Detection of Internal Mechanical Damage of Blueberry Using Hyperspectral Transmittance Data

Non-destructive detection of single-seed viability in maize using hyperspectral imaging technology and multi-scale 3D convolutional neural network

DEEP FEATURE REPRESENTATION WITH STACKED SPARSE AUTO-ENCODER AND CONVOLUTIONAL NEURAL NETWORK FOR HYPERSPECTRAL IMAGING-BASED DETECTION OF CUCUMBER DEFECTS

Detection of sweet corn seed viability based on hyperspectral imaging combined with firefly algorithm optimized deep learning

Corn Seed Defect Detection Based on Watershed Algorithm and Two-Pathway Convolutional Neural Networks

Spectral and Image Integrated Analysis of Hyperspectral Data for Waxy Corn Seed Variety Classification