Abstract:Maize is a crop that is widely cultivated all over the world. Thus, the classification of maize seeds quality is important, while the traditional methods based on the texture, shape, and color which require repeated work is not efficient. Recently, deep learning reached the goal in the field of image processing, and a deep convolutional neural network (DCNN) is often used to do the image classification task. Here, we explored another neural network called Vision Transformer (ViT), which originally was applied to the natural language processing. Based on the self-attention mechanism, ViT discards the convolutional structure. But when trained from scratch on medium-sized datasets, ViT performed poorly compared to CNN. Due to the lack of local structure within the input image, tokenization cannot be used to generate a valid training set in the original ViT model. As a result, we proposed an improved ViT model SeedViT. Compared with the original ViT which could only train large datasets, SeedViT can train small and medium datasets to achieve SOTA (State of the Art) in vision classification with only 2,500 images in our study. The feasibility of SeedViT to classify maize seeds' quality was studied in this article, and we compared it with DCNN and traditional machine learning algorithms. The accuracy, sensitivity, specificity, and precision were 97.6%, 94.1%, 98.9%, and 97%, respectively. In addition, we employed ViT and VGG (Visual Geometry Group, a convolutional neural network) to extract image features, and SVM (support vector machine) was used as the classifier to classify them, with the result that ViT-SVM was stable around 96.6% on the test set and VGG-SVM was stable around 94.6%. At last, a visual attention map was generated by visualization technology. It showed that SeedViT can be a new and novel way for maize seed manufacturing. Practical applications An algorithm for classifying and sorting out high-quality maize seeds. Use the Transformer algorithm from the field of natural language processing instead of the convolutional neural network algorithm. Use GeLU function for activation and soft split with images to improve Vision Transformer model so that it can achieve great performance with small and medium datasets.

A Comparison for Patch-level Classification of Deep Learning Methods on Transparent Environmental Microorganism Images: from Convolutional Neural Networks to Visual Transformers

A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers

A Novel Hybrid Transformer-Cnn Architecture for Environmental Microorganism Classification.

A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer

Identification of environmental microorganism using optimally fine-tuned convolutional neural network

Visualization Comparison of Vision Transformers and Convolutional Neural Networks

Vision Transformer With Contrastive Learning for Remote Sensing Image Scene Classification

Segmentation of Weakly Visible Environmental Microorganism Images Using Pair-wise Deep Learning Features

Artificial Intelligence Approach for Classifying Images of Upper-Atmospheric Transient Luminous Events

COMPARISON OF VISION TRANSFORMERS AND CONVOLUTIONAL NEURAL NETWORKS FOR SKIN DISEASE CLASSIFICATION

A Vision Transformer Network SeedViT for Classification of Maize Seeds

Nested-TNT: Hierarchical Vision Transformers with Multi-Scale Feature Processing

Lightweight Visual Transformers Outperform Convolutional Neural Networks for Gram-Stained Image Classification: An Empirical Study

A comparative study between vision transformers and CNNs in digital pathology

A vision transformer for emphysema classification using CT images

Performance Evaluation of Deep Learning Classification Network for Image Features

A new pairwise deep learning feature for environmental microorganism image analysis

VisionTwinNet: Gated Clarity Enhancement Paired With Light-Robust CD Transformers

Comparison between transformers and convolutional models for fine-grained classification of insects

Triple Attention Vision Transformers for Remote Sensing Image Classification

Vision Transformers for Weakly-Supervised Microorganism Enumeration