Abstract:The development of vaccines and drugs is very important in combating the coronavirus disease 2019 (COVID-19) virus. The effectiveness of these developed vaccines and drugs has decreased as a result of the mutation of the COVID-19 virus. Therefore, it is very important to combat COVID-19 mutations. The majority of studies published in the literature are studies other than COVID-19 mutation prediction. We focused on this gap in this study. This study proposes a robust transformer encoder based model with Adam optimizer algorithm called TfrAdmCov for COVID-19 mutation prediction. Our main motivation is to predict the mutations occurring in the COVID-19 virus using the proposed TfrAdmCov model. The experimental results have shown that the proposed TfrAdmCov model outperforms both baseline models and several state-of-the-art models. The proposed TfrAdmCov model reached accuracy of 99.93%, precision of 100.00%, recall of 97.38%, f1-score of 98.67% and MCC of 98.65% on the COVID-19 testing dataset. Moreover, to evaluate the performance of the proposed TfrAdmCov model, we carried out mutation prediction on the influenza A/H3N2 HA dataset. The results obtained are promising for the development of vaccines and drugs.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to predict the mutations of the COVID - 19 virus. Specifically, the author points out: 1. **Decline in the effectiveness of vaccines and drugs**: Due to the frequent mutations of the COVID - 19 virus, the effectiveness of the developed vaccines and drugs has declined. 2. **Importance of mutation prediction**: Accurately predicting the mutations of the COVID - 19 virus is crucial for updating vaccines and developing new drugs. 3. **Deficiencies in existing research**: Most of the existing research focuses on other aspects rather than specifically on the prediction of COVID - 19 virus mutations. To solve these problems, the author proposes a model based on the Transformer encoder model and using the Adam optimization algorithm, called TfrAdmCov, for predicting the mutations of the COVID - 19 virus. The main motivation of this model is to predict the mutations occurring in the COVID - 19 virus through the TfrAdmCov model to help quickly update vaccines and develop new drugs. ### Main features of the model: - **Transformer encoder**: It can easily capture the long - term dependencies in the input sequence and perform large - scale parallel computing. - **Adam optimization algorithm**: It is used to improve the training efficiency and performance of the model. - **Multi - Head Attention mechanism (MHA)**: It allows the model to participate in information sharing simultaneously in different representation sub - spaces, thereby improving the expressive ability and generalization performance of the model. ### Experimental results: - On the COVID - 19 test data set, the TfrAdmCov model achieved 99.93% accuracy, 100.00% precision, 97.38% recall, 98.67% F1 - score and 98.65% Matthews correlation coefficient (MCC). - This model also carried out mutation prediction on the influenza A/H3N2 data set, and the results show that it has great potential in vaccine and drug development. ### Summary: This research fills the gap in the field of COVID - 19 virus mutation prediction. The proposed TfrAdmCov model is superior in performance to the existing baseline models and other state - of - the - art models, providing a powerful tool for dealing with COVID - 19 virus mutations.

TfrAdmCov: a robust transformer encoder based model with Adam optimizer algorithm for COVID-19 mutation prediction

TEMPO: A Transformer-Based Mutation Prediction Framework for SARS-CoV-2 Evolution

COVID-19 virus mutation prediction with LSTM and attention mechanisms

PhyloTransformer: A Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism

Predicting the Epidemics Trend of COVID-19 Using Epidemiological-Based Generative Adversarial Networks.

Adversarial Training for Predicting the Trend of the COVID-19 Pandemic

Variation and Evolution Analysis of SARS-CoV-2 Using Self-Game Sequence Optimization

PhyloTransformer: A Self-supervised Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism

Predicting the immune escape of SARS-CoV-2 neutralizing antibodies upon mutation

MMViT-Seg: A Lightweight Transformer and CNN Fusion Network for COVID-19 Segmentation.

TDFFM: Transformer and Deep Forest Fusion Model for Predicting Coronavirus 3C-Like Protease Cleavage Sites

CovTransformer: A transformer model for SARS-CoV-2 lineage frequency forecasting

Machine Learning in Bioinformatics: COVID-19 Mutation Prediction

Evolution-guided Large Language Model is a Predictor of Virus Mutation Trends

A Transformer-Based Model Trained on Large Scale Claims Data for Prediction of Severe COVID-19 Disease Progression

COVID-19 detection using ViT transformer-based approach from Computed Tomography Images

UncertaintyFuseNet: Robust Uncertainty-aware Hierarchical Feature Fusion Model with Ensemble Monte Carlo Dropout for COVID-19 Detection

Fitness dependent optimizer with neural networks for COVID-19 patients

TransEFVP: A Two-Stage Approach for the Prediction of Human Pathogenic Variants Based on Protein Sequence Embedding Fusion

EffViT-COVID: A dual-path network for COVID-19 percentage estimation

Tempel: time-series mutation prediction of influenza A viruses via attention-based recurrent neural networks