Abstract:Maize is a crop that is widely cultivated all over the world. Thus, the classification of maize seeds quality is important, while the traditional methods based on the texture, shape, and color which require repeated work is not efficient. Recently, deep learning reached the goal in the field of image processing, and a deep convolutional neural network (DCNN) is often used to do the image classification task. Here, we explored another neural network called Vision Transformer (ViT), which originally was applied to the natural language processing. Based on the self-attention mechanism, ViT discards the convolutional structure. But when trained from scratch on medium-sized datasets, ViT performed poorly compared to CNN. Due to the lack of local structure within the input image, tokenization cannot be used to generate a valid training set in the original ViT model. As a result, we proposed an improved ViT model SeedViT. Compared with the original ViT which could only train large datasets, SeedViT can train small and medium datasets to achieve SOTA (State of the Art) in vision classification with only 2,500 images in our study. The feasibility of SeedViT to classify maize seeds' quality was studied in this article, and we compared it with DCNN and traditional machine learning algorithms. The accuracy, sensitivity, specificity, and precision were 97.6%, 94.1%, 98.9%, and 97%, respectively. In addition, we employed ViT and VGG (Visual Geometry Group, a convolutional neural network) to extract image features, and SVM (support vector machine) was used as the classifier to classify them, with the result that ViT-SVM was stable around 96.6% on the test set and VGG-SVM was stable around 94.6%. At last, a visual attention map was generated by visualization technology. It showed that SeedViT can be a new and novel way for maize seed manufacturing. Practical applications An algorithm for classifying and sorting out high-quality maize seeds. Use the Transformer algorithm from the field of natural language processing instead of the convolutional neural network algorithm. Use GeLU function for activation and soft split with images to improve Vision Transformer model so that it can achieve great performance with small and medium datasets.

An efficient transformer algorithm for image recognition based on ensemble learning methodology

Crop Disease Identification by Fusing Multiscale Convolution and Vision Transformer.

Deep learning for mango leaf disease identification: A vision transformer perspective

Using Transfer Learning for Image-Based Cassava Disease Detection

Agricultural innovation through deep learning: a hybrid CNN-Transformer architecture for crop disease classification

Efficient Mobile Deployment of Lightweight CNN-Transformer Model for Crop Disease Diagnosis in Smart Agriculture

A Fresh Look at Tomato Leaf Disease Recognition using Vision Transformers

Vision transformer meets convolutional neural network for plant disease classification

Explainable vision transformer enabled convolutional neural network for plant disease identification: PlantXViT

A deep learning based approach for automated plant disease classification using vision transformer

Convolution Self-Guided Transformer for Diagnosis and Recognition of Crop Disease in Different Environments

Processing Plant Diseases Using Transformer Model

An Improved EfficientNetV2 Model Based on Visual Attention Mechanism: Application to Identification of Cassava Disease

A Novel Hybrid Transformer-Cnn Architecture for Environmental Microorganism Classification.

Image-based crop disease detection with federated learning

Hybrid ensemble - deep transfer model for early cassava leaf disease classification

FOTCA: hybrid transformer-CNN architecture using AFNO for accurate plant leaf disease image recognition

A Vision Transformer Network SeedViT for Classification of Maize Seeds

Vision Transformers For Weeds and Crops Classification Of High Resolution UAV Images

Enhancing sugarcane leaf disease classification through a novel hybrid shifted-vision transformer approach: technical insights and methodological advancements

Transfer learning for versatile plant disease recognition with limited data