Spectral-Spatial Feature Extraction Enhanced Fully Connected Neural Network: Pixel-Wise Mechanical Damage Detection of Fresh-Eaten Corn Using Hyperspectral Image

Fengshuang Liu,Jun Fu,Qiang Wang,Rongqiang Zhao
DOI: https://doi.org/10.2139/ssrn.4199291
2022-01-01
SSRN Electronic Journal
Abstract:Detection of mechanical damage on fresh-eaten corn is a critical process to guarantee corn quality and meet the processing demands of fresh-eaten corn. A novel spectral-spatial feature extraction enhanced fully connected neural network (SSFE-FCNN) classification method is proposed in this paper to achieve pixel-wise mechanical damage detection of fresh-eaten corn using hyperspectral image (HSI). Different from the previous HSI-based detection methods for food and agriculture products, which only utilize the spectral information in HSI, SSFE-FCNN extracts joint spectral-spatial features to improve the detection performance. To remove the noise in HSI and reduce the calculation cost, SSFEFCNN utilizes principal component analysis to reduce the spectral dimensions of HSI. The sparse tensor-based dictionary learning (STDL) extracts threedimensional (3-D) joint spectral-spatial tensor features from 3-D HSI cubes. A simple fully connected neural network (FCNN) is designed as a classifier, to learn high-level semantic features from the feature tensors obtained by STDL and provide pixel-wise classification results. Besides, the majority vote utilizes spatial information of the probability label map obtained by FCNN to refine the classification. Experimental results on HSI of fresh-eaten corn show that the proposed SSFE-FCNN is superior to support vector machine and convolutional neural network-based methods. The overall accuracy of SSFE-FCNN in the pixel-wise classification of fresh-eaten corn achieves as high as 98.09%, the false detection rate of the proposed method in the pixel-wise detection of mechanical damage achieves 2.08%, and the missing detection rate achieves 1.96%. Furthermore, the final classification maps obtained by pixel-wise classification can visualize the shape and location of mechanical damage.
What problem does this paper attempt to address?