Abstract:Deep learning methods have been applied when working to enhance the prediction accuracy of traditional statistical methods in the field of plant breeding. Although deep learning seems to be a promising approach for genomic prediction, it has proven to have some limitations, since its conventional methods fail to leverage all available information. Multimodal deep learning methods aim to improve the predictive power of their unimodal counterparts by introducing several modalities (sources) of input information. In this review, we introduce some theoretical basic concepts of multimodal deep learning and provide a list of the most widely used neural network architectures in deep learning, as well as the available strategies to fuse data from different modalities. We mention some of the available computational resources for the practical implementation of multimodal deep learning problems. We finally performed a review of applications of multimodal deep learning to genomic selection in plant breeding and other related fields. We present a meta-picture of the practical performance of multimodal deep learning methods to highlight how these tools can help address complex problems in the field of plant breeding. We discussed some relevant considerations that researchers should keep in mind when applying multimodal deep learning methods. Multimodal deep learning holds significant potential for various fields, including genomic selection. While multimodal deep learning displays enhanced prediction capabilities over unimodal deep learning and other machine learning methods, it demands more computational resources. Multimodal deep learning effectively captures intermodal interactions, especially when integrating data from different sources. To apply multimodal deep learning in genomic selection, suitable architectures and fusion strategies must be chosen. It is relevant to keep in mind that multimodal deep learning, like unimodal deep learning, is a powerful tool but should be carefully applied. Given its predictive edge over traditional methods, multimodal deep learning is valuable in addressing challenges in plant breeding and food security amid a growing global population.

A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding

A review of deep learning applications for genomic selection

Deep learning methods improve genomic prediction of wheat breeding

Integrating omics databases for enhanced crop breeding

Multimodal deep learning methods enhance genomic prediction of wheat breeding

Machine learning algorithms translate big data into predictive breeding accuracy

Genome-Wide Prediction of Complex Traits in Two Outcrossing Plant Species Through Deep Learning and Bayesian Regularized Neural Network

A review of machine learning models applied to genomic prediction in animal breeding

Plant Genotype to Phenotype Prediction Using Machine Learning

Genomic prediction using machine learning: a comparison of the performance of regularized regression, ensemble, instance-based and deep learning methods on synthetic and empirical data

A Benchmarking Between Deep Learning, Support Vector Machine and Bayesian Threshold Best Linear Unbiased Prediction for Predicting Ordinal Traits in Plant Breeding

Machine Learning Bridges Omics Sciences and Plant Breeding.

A New Deep Learning Calibration Method Enhances Genome-Based Prediction of Continuous Crop Traits

Deep learning for plant genomics and crop improvement

Ideas in Genomic Selection that Transformed Plant Molecular Breeding: A Review

Ideas in Genomic Selection with the Potential to Transform Plant Molecular Breeding

Prediction and importance of predictors in approaches based on computational intelligence and machine learning

Digitalizing breeding in plants: A new trend of next-generation breeding based on genomic prediction

Application Of Deep Learning In Genomic Selection

Smart breeding driven by big data, artificial intelligence, and integrated genomic-enviromic prediction

Multi-trait and multi-environment genomic prediction for flowering traits in maize: a deep learning approach